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THE SELECTION OF STUDENT NURSES 


E. G. WILLIAMSON, R. D. STOVER anp C. B. FISS 
University of Minnesota 


N 1934 The Minnesota League of Nursing Education ap- 
I pointed a committee on testing to supervise a program of 
research designed to yield improved methods of selecting 
students for the private schools of nursing in the state. This 
committee engaged the services of the University of Minnesota 
Testing Bureau to conduct this research program, a final report 
of which was made in January, 1937. 

Students enrolling in some twenty schools in the fall of 1934, 
the winter of 1935 and the fall of 1935 were tested with a large 
battery of tests. At the close of the first year of instruction, 
these tests were correlated against each student’s grades in the 
various subjects of instruction. Five criteria of success were 
used : (1) average grade in science courses, t.¢., anatomy, physi- 
ology, bacteriology and chemistry ; (2) average grade in prac- 
tical courses, i.e., principles and practice of nursing; (3) 
average grade in clinical courses, i.e., medical and surgical 
nursing, obstetrics, and pediatrics; (4) average grade in all 
courses in the first year of instruction; (5) total score on an 
objective examination covering the subjects of instruction in 
all schools during the first year (constructed by Sister M. 
Domitilla). The odd-even reliability of this test for 342 items 
was .87 (corrected). Unfortunately no complete record was 
kept by the schools of the grades of students who left or were 
dismissed from training during the first year. This fact re- 
duces the study to a prediction of grades of those students who 
completed one year of training and introduces certain statistical 
obstructions to a straightforward attack on the main problem. 

The validity of the tests for prediction of grades was analyzed 
by three separate methods, first determining the coefficients of 
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correlations between the various tests, singly and in batteries, 
and each of the five criteria of success for all students grouped 
without regard to the nursing school ; secondly, finding the cor- 
responding coefficients computed separately by schools; and 
thirdly, comparing the test scores of all students enrolled as 
freshmen with the scores of those who were still enrolled at the 
end of the first year. 


Statistical Variables 


The following chart lists the code number of each of the five 
criteria of success and of all tests used to predict these criteria. 
The test battery was varied somewhat for the three groups of 
freshmen students. 


Code 
A. HONOR POINT RATIO FOR SCIENCE GRADES (referred to in 
text as science grades). 
B. HONOR POINT RATIO FOR CLINICAL GRADES (referred to in 
text as clinical grades). 
C. HONOR POINT RATIO FOR PRACTICAL GRADES (referred to 
in text as practical grades). 
HONOR POINT RATIO FOR TOTAL GRADES (referred to in 
text as total grades). 
NURSING COMPREHENSIVE EXAMINATION, 
COLLEGE APTITUDE TEST (Cooperative Vocabulary). 
MOSS NURSING APTITUDE TEST. 
COOPERATIVE ENGLISH TEST (Usage and Spelling). 
COOPERATIVE GENERAL SCIENCE TEST. 
OTIS MENTAL ABILITY TEST. 
GORDON ’S NURSES FRACTIONS TEST. 
HIGH SCHOOL PERCENTILE RANK. 
MINNESOTA VOCATIONAL TEST FOR CLERICAL WORKERS 
(NUMBERS). 
9. MINNESOTA VOCATIONAL TEST FOR CLERICAL WORKERS 
(NAMES). 
10. MONROE FRACTIONS TEST. 


a 


erngaapwenpy 


Coefficients of Correlations for all Students 


The battery of tests was changed slightly from one greup to 
another and, as a consequence, the following tables do not in- 
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clude coefficients for all variables. In addition, high school 
grades were not available for all students. 

Table I gives the coefficients for 168 students enrolled in the 
schools in the fall of 1934. 


TABLE I 
Coefficients for 168 Students Enrolled in 1934 


VARIABLE 


1 9 10 


amis ‘ < ‘ ‘ 23 | .18 
we Ts ‘ P d . 14 | .15 
33 | . ‘ ° P . 17 | .09 
24] «| d A , . 24 | 18 
46]. z d - ‘ 28 | .13 


A. 1234789 10=.48 C. 1234789 10=.49 E. 1234789 10 = .54 
B. 1234789 10=.38 D. 1234789 10=.47 E. ABC = .54 








CRITERION 



































There is nothing particularly outstanding or different in the 
coefficients for this group. None of the coefficients are very 
high, even those with the Moss test. The coefficients between 
the two sections of the Clerical Aptitude Test and the criteria 
are so low that they were not administered to the group entering 
in the fall of 1935. It should be noted that the Comprehensive 
Examination did not correlate very high with either the tests 
or the other criteria. 

TABLE II 
Coefficients for 219 Students Enrolled in the Fall of 1935 
1 2 3 4 5 6 


2801 | .3726 | .2531 | .3806 | .1767 | .3886 
1873 | .3464 | .1494 | .2036 | .2139 | .2474 
0550 | .2024 | .1283 | .1173 | .0164 | .1377 
2328 | .3704 | .1891 | .2285 | .1303 | .3523 
3492 | .3748 | .2541 | .3186 | .2987 | .3435 


A. 123456 = .5002 C. 123456 = .2608 E, 123456 = .4751 
B. 123456 = .3726 D. 123456 = .4504 E. ABC = .6409 
































In general, the coefficients in Table II are much the same as 
those in the preceding table. The coefficients obtained by cor- 
relating the Otis Mental Ability Test with the criteria are not 
as high as could be expected when correlating a measure of 
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mental ability with measures of scholastic achievements. Cor- 
relations with criterion C (practical grades) are lower than for 
the preceding year. Again we note that a standardized test 
like the Moss Nursing Aptitude Test does not correlate highly 
with grades. But the Comprehensive Examination does cor- 
relate higher with other criteria than was true for the preceding 
year’s students. 

The most outstanding point about the correlation coefficients 
in the preceding tables is that, generally speaking, they are 
rather low. Most of them indicate the presence of some relation 
and some indicate a marked relationship between the tests and 
criteria. In general, the four tests, Moss Nursing Aptitude 
Test, College Aptitude Test, Cooperative English Test, and the 
Cooperative General Science Test yielded the best results. 

If the assumptions that grades are a true rating of ability, 
and that the tests are an accurate measure of that ability are 
true, we should expect high coefficients when correlating the 
two. Evidently there is something wrong with either the 
grades or the tests. Since nearly all the tests used are stand- 
ardized measures which have produced higher coefficients in 
other school units, it would seem that the grading systems are 
in large part at fault.* 

It is significant to note that science grades in almost every 
ease correlate more highly with the tests than do either the 
clinical or practical grades. This is possibly due to that fact 
that scientific subjects, because they are more tangible, lend 
themselves more readily to objective prediction and measure- 
ment than clinical and practical subjects which depend to such 
a large extent upon the subjective judgment of instructors. 


Correlations of Tests with Grades for Students in 
Separate Schools 


In order to ascertain to what extent the differing grading 


1In an unpublished study Dr. H. R. Douglass found coefficients above 
.60 between the Moss test and grades in The School of Nursing at the 
University of Minnesota. This test, together with high school grades, 
Cooperative General Science Test and the Gordon Fractions Test yielded 
multiple correlations in the high .70’s. 
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systems employed in the various nursing schools affected the 
correlations, an analysis of the separate schools was made. To 
do this it was necessary to use only those tests common to all 
groups. These are the College Aptitude Test, Moss Nursing 
Aptitude Test, Cooperative English Test and the Cooperative 
General Science Test. In general, the correlations for the indi- 
vidual schools were appreciably higher than those of the total 
groups. Space permits reproduction of the coefficients for 
only two schools. 


A. HONOR POINT RATIO FOR SCIENCE GRADES (referred to in 
text as science grades). 
B. HONOR POINT RATIO FOR CLINICAL GRADES (referred to 
in text as clinical grades). 
C. HONOR POINT RATIO FOR PRACTICAL GRADES (referred to 
in text as practical grades). ; 
. HONOR POINT RATIO FOR TOTAL GRADES (referred to in 
text as total grades). 
. NURSING COMPREHENSIVE EXAMINATION. 
. COLLEGE APTITUDE TEST (Cooperative Vocabulary). 
. MOSS NURSING APTITUDE TEST. 
. COOPERATIVE ENGLISH TEST (Usage and Spelling). 
. COOPERATIVE GENERAL SCIENCE TEST. 


TABLE III 
Correlations of Tests with Grades for 29 Students in School A 


1 2 3 4 


5562 5009 4762 4852 
4260 6462 4770 4982 
0301 -1065 2421 .2909 
4377 4909 5308 5833 
5599 6252 4341 -7165 


A. 1234=.6631 C. 1234 = .4046 E. 1234 = .8009 
B. 1234 =.7319 D. 1234 = .7308 E. ABC =.7169 


























The coefficients obtained by correlating the criteria with the 
tests for students in School A (Table III) are generally high. 
With the exception of those correlations including the practical 
grades where a very poor distribution of grades may have low- 
ered the correlations (see Table V below), the coefficients are 
nearly all close to .50 and several of them are over .60. The 








124 E. G. WILLIAMSON, R. D. STOVER AND C. B. FISS 


Comprehensive Examination correlated with the General Sci- 
ence Test to yield a coefficient of .72, and with Moss Nursing 
Aptitude Test to yield a coefficient of .62, while clinical grades 
correlated with Moss Nursing Aptitude Test to yield a coeffi- 
cient of .65. But criterion C (practical grades) correlates low 
with all variables. The multiple correlations are also indicative 
of significant relationship. The coefficient of .80 between the 
Comprehensive Examination and the prognostic tests is espe- 
cially worthy of note. 

















TABLE IV 
Correlations of Tests with Grades for 43 Students in School K 
1 2 3 4 
PRG ae .3640 .6604 4302 5618 
We ikon 2293 4835 .2684 3403 
I liaicass 4423 .6916 .4969 5512 
BF tavabeitid. .3849 .6428 4332 5587 
ia 4632 .6025 4288 .7290 
A. 1234= .7244 C. 1234 = .7491 E. 1234 =.7741 
B. 1234=.5103 D. 1234 = .7067 E. ABC =.7789 











The coefficients obtained for this group indicate as a whole a 
quite favorable relationship between the tests and criteria. 
The coefficients of .73 between the Cooperative General Science 
Test and the Comprehensive Examination; .60 between the 
Moss Nursing Aptitude Test and the Comprehensive; .66 be- 
tween the Moss and science grades ; and .69 between Moss Nurs- 
ing Aptitude and practical grades are particularly significant. 
The coefficients of multiple correlation are also indicative of 
high relationship between the tests and criteria. For the first 
time, criterion C correlates high with tests. 

Contrast the coefficients mentioned above with those of the 
total groups and it will be evident that there is some influence 
operative in the large groups which is ruled out in the groups 
from separate schools. While it is possible that these differ- 
ences may be caused by differences in the number of cases, yet 
data presented in the next section indicate that other factors 
are operative. 
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Analysis of Distributions of Grades for Separate Schools 

In the distribution of grades in a single course in educational 
institutions the normal distribution is generally considered to 
be 7 per cent, A’s; 21 per cent, B’s; 44 per cent, C’s; 21 per 
cent, D’s; and 7 per cent, F’s; that is, usually 7 per cent will 
receive A grades, ete. For purposes of this study the F’s will 
have to be eliminated because those students are assumed to 
have dropped out of training before the end of the first year. 
The revised distribution would therefore be: 8 per cent, A’s; 
22 per cent, B’s; 48 per cent, C’s; and 22 per cent, D’s. That 
is, we might reasonably expect such a distribution of grades in 
most schools. 

Each distribution on the chart below is a distribution of the 
grades in a single course, e.g., for one year’s class. This table 
illustrates some of the faults that can be found with the grading 
systems. Contrast the distributions for the schools given in the 
table with the normal distribution. It will be seen that with 
the exception of the distribution for School K they deviate very 
greatly from the normal distribution. We might wonder 
whether some schools have unusually incompetent students or 
if the grading standards are inaccurate. 


TABLE V 


Distributions of Percentages of Grades for Single Courses 
in Different Schools 





PER CENT | PER CENT | PER CENT | PER CENT 
B’sS D’s 


A’s c’s 


**Normal’’ Grade Distribution 8 22 48 22 
School A, Practical Courses 





91 9 
27 73 
100 


50 44 
#8 44 25 
oe, 6 38 

School C, Clinical Courses 
I dicen 71 
REE OF ED 97 
School B, Clinical Course 8 
School K, Practical Course 51 
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In the discussion of multiple correlations in the foregoing 
pages the statement was made that the correlation between prac- 
tical grades and tests was the poorest of the multiple correla- 
tions for School A. The four distributions listed under School 
A in Table V are the four courses that make up the Honor 
Point Ratio for Practical Grades. These distributions suggest 
the probable cause of the low coefficient obtained. Clearly 
these distributions are far from normal. No A’s or D’s were 
given at all and in two of the courses everyone received a C. 
Another teacher gave practically all B’s and in the other course 
three-fourths of the students got C’s and one-fourth got B’s. 
Such distributions are not found in the freshman classes of 
other educational institutions. Why are they found in nursing 
schools ? 

The distributions for School A and for School G also illus- 
trate that differences in grading between classes in the same 
school do exist and that these differences are by no means small 
as can be seen by looking at the table. 

The multiple correlations for the schools whose distributions 
are given on the above table are, with the exception of School K, 
those which have the lowest coefficients. The distribution of 
grades on a practical course for School K approximates very 
closely the normal distribution. Possibly this accounts, in part, 
for the high multiple coefficient (.75) between practical grades 
and tests for this school. In general the schools which had the 
best distribution of grades had the highest correlation coeffi- 
cients. This is just another way of repeating that with a faulty 
criteria (grades) it is almost impossible to show the true value 
of tests for prognostic purposes. 

From inspection of Table V one might suppose that there 
were great differences between the ability of the students of 
one school and those of another; that is, that some schools 
enroll students who have much higher average ability than those 
in another school. This supposition is not borne out by the 
comparison of the means and standard deviations of the stu- 
dents for the separate schools (not given in this paper). The 
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differences between the means of the test scores for separate 
schools and the average for the whole group are not as great 
as the differences between the means of the distribution of 
grades for separate schools and the mean for the total group. 
It is evident, therefore, that while there is no very appreciable 
difference between the levels of ability among the schools, there 
are marked differences in the grades given in the different 
schools. Also, it appears that some of the schools having stu- 
dents of slightly higher than average ability gave low average 
marks. On the other hand, some of the schools enrolling stu- 
dents with slightly lower than average ability gave high average 
marks. These data indicate the probability that two students 
with similar ability, as measured by the tests, but enrolling in 
two different schools would not receive comparable grades. If 
grades are thus assigned on the basis of such dissimilar stand- 
ards, then it becomes apparent that prediction of success in 
some schools is difficult if not impossible. 


Variability of Group Before and After Elimination 


The standard deviations of test scores for the group before 
and after the elimination of failing students are about the same 
(see Table IV). This means that the variability of the group 
of students remaining in training at the end of the first year 
is as great as that of the group that started training. A com- 
parison of the means of the two groups is no more encouraging ; 
they also remain about the same before and after elimination 
whereas the average for the selected group should be signifi- 
cantly higher. 

This would seem to indicate that the elimination or failing 
of students in the various schools may not be entirely or even 
largely based on the scholastic aptitude and ability of the stu- 
dents. Either the failing of students is random or it is based 
on such factors as health, personality, personal feéling of 
instructors, and other factors not measured by the test battery. 

A separate tabulation was made of those students who 
dropped out of training during the year. The tabulation was 
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divided into two classes: those who left training voluntarily 
and those who were dismissed from training. Of those who 
left voluntarily about 2 per cent left because of failing grades. 
This may explain why some of the means of the distributions 
did not rise at the end of the first year over what they were at 
the beginning of the year. Of those who left, there were proba- 
bly just as many who had high grades as those who had low 
grades, which would not raise the means of the distributions. 
Of those who were dismissed, the majority were reported as 
dismissed because of failing grades. This may be true but it 
is evident that many of these failing grades were given because 
of the personality of the student and not on the basis of apti- 
tude. From an inspection of Table VI it would seem that the 
failing grades were not assigned to those of low ability alone 
but were also assigned to students of high ability. Of course 
it is to be expected that many high-aptitude students will not 
use their aptitude efficientiy but the extent of this condition in 
this study of nursing schools is greater than for other profes- 
sional training schools. 

The results obtained on the fall, 1935 group are more encour- 
aging. In this group the standard deviations after selective 
factors have operated are slightly lower. Although the differ- 
ence is slight and not significant enough to say that the drop- 
ping of students is based mostly on their scholastic aptitude 
and ability, it is an improvement over the other groups studied. 
The means except for the College Aptitude Test are also slightly 
higher after elimination, which is another improvement. 
Whether this improvement is brought about by the operation 
of chance factors or by improved methods of failing and pass- 
ing students remains to be discovered in future studies. 


Conclusions 


Throughout the entire study there are many indications that 
unstandardized and haphazard grading may be the cause of 
the low correlations between the tests and criteria. The higher 
correlations for some of the separate schools strongly support 
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this contention. These higher coefficients probably are caused 
by the fact that the vitiating influence of unstandardized grad- 
ing systems and varying course content among the various 
schools have been controlled statistically. The analysis of the 
distributions of grades for certain courses in several of the 
schools show that the instructors within one school do not agree 
among themselves and that their distributions of grades are 
far from normal. If these distributions more closely approxi- 
mated the normal, it is likely that the resulting coefficients 
would be higher than those obtained under present conditions. 

From all these indications we are justified in assuming that 
the tests could be used to great advantage in selecting candi- 
dates for nursing training if instructors’ grades were more 
valid. When we consider that, even under present conditions, 
the coefficients between the tests and the criteria indicate the 
presence of some degree of relationship, this assumption is well 
within reason. 

The study was nearly made impossible because almost none 
of the schools recorded any grades for failing students. This 
condition made it impossible to use these failing students for 
purposes of analysis in this study and consequently restricted 
the range of grades used in this study to the passing students 
who supposedly possess greater ability than those dropping out 
of training. If this supposition, that the students leaving 
training are of inferior ability, is correct, it would follow that 
their test scores would be low. But the test scores of the two 
groups were almost identical, showing that many students were 
dismissed or left training not because of low ability but because 
of lack of skill in the use of that ability, because of personality 
deficiencies or because of the fact that many grades were 
assigned for invalid reasons. Carrying the supposition further, 
it can readily be seen that cutting off this lower end of the 
distribution would lower the correlation coefficients because the 
value of these positive relationships between low grades and low 
test scores is entirely lost. It was, therefore, expected that 
because of the restricted range of the data the correlations 
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would be so low as to be of no value. But the fact that the 
correlations, despite these vitiating conditions, were not negli- 
gible in size indicates that the tests could be used with reason- 
able accuracy if the schools used more acceptable bases for 
passing and failing students in training. If such educational 
practices had been followed, the results of this study might have 
been more encouraging. 

It is difficult for one to expect more accurate identification 
of successful students unless and until major reforms are insti- 
tuted in educational practices in schools of nursing. Instruc- 
tors in nursing must be taught how to make better class exami- 
nations and how to do a more accurate and thorough job of 
assigning grades to students. Moreover, drastic revisions must 
be made in the rating of efficiency in the so-called practical 
nursing courses. Under such conditions it is probable that 
tests of the type used in this study will yield fairly accurate 
identification of potentially successful students. 








SOCIAL DOMINANCE AND SALES 
PERSONALITY 


ARTHUR F. DODGE 
University of Illinois 


N a previous article’ the writer called attention to the ten- 
dency for sales-persons to score high in social dominance as 
measured by the Bernreuter Personality Inventory. It 

was pointed out, however, that this should not be accepted as 
proof that a high score in social dominance is any indication 
of degree of success as a salesman. This article reports an 
attempt to discover what relationship, if any, exists between 
social dominance and sales success and further to set up a 
measure of personality which will have as high a correlation as 
possible with sales success. 

Seventy-five salespeople from a large department store were 
given the Bernreuter Personality Inventory. This group was 
composed of 41 men and 34 women. The writer then requested 
the store personnel manager to indicate, from this total group, 
a small group of the best salespeople and a small group of the 
poorest salespeople. Nine men and nine women were selected 
by the personnel manager, in conference with department 
heads, as being the most successful salespeople and eight men 
and seven women as the least successful. The personality in- 
ventories of these best and poorest salespeople were then scored 
for social dominance (B4—D). Table I indicates the individual 
scores. 

The scores shown in this table confirm the tendency, already 
mentioned, for salespeople to score high in social dominance. 
The midscore of +100 for the group of best salesmen and the 
midscore of +934 for the group of poorest salesmen are both 


1 Dodge, Arthur F. ‘‘Social Dominance of Clerical Workers and Sales- 
Persons,’’ Journal of Educational Psychology, Vol. XXVIII, No. 1, p. 71. 
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TABLE I 
Social Dominance Scores (B4—D) of Best and Poorest Salespeople 








BEST POOREST BEST POOREST 
SALESMF,’ SALESMEN SALESWOMEN SALESWOMEN 
+148 +148 +100 +118 
+114 +123 + 82 + 40 
+111 +103 + 67 + 30 
+100 + 94 + 57 + 17 
+100 + 93 + 48 + 12 
+ 80 + 74 + 35 - 19 
+ 80 + 64 - 8 -— 34 
+ 56 - 30 - 21 
+ 35 — 26 














even higher than the median score of the group of retail sales- 
men reported in the previous article. The midscore of + 48 for 
the group of best saleswomen is slightly higher than the median 
score of the group of retail saleswomen reported in the pre- 
vious article, but the midscore of + 17 for the group of poorest 
saleswomen is much lower although even this score is slightly 
higher than the median score for adult women (+15) as given 
in the table of norms published (October, 1934) in connection 
with this personality inventory. ) 

The midscores for these four groups and also a scanning of 
the individual scores in Table I indicate a tendency for the 
best salespeople to score higher than the poorest salespeople. 
If the group of best salesmen and the group of poorest sales- 
men are considered as a single group, the correlation between 
sales success and social dominance score is found to be 
+.16 + .16.2 If the two groups of saleswomen are similarly 
considered as a single group, the correlation is found to be 
+.31 + .15. 

Such correlations are low especially when we consider that 
the individuals in these two groups represent extremes of sales 

2 All coefficients of correlation mentioned in this article were computed 


2 
aay as this method 


seemed sufficiently accurate for the purposes of this study. 


on the basis of rank, using the formula p=1- 
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success. Also, a glance at Table I reveals the impossibility of 
setting any critical score which would separate the successful 
from the unsuccessful salespeople with even a fair degree of 
effectiveness. 

In view of the low correlations revealed, even though the 
groups were specially selected to represent extremes of sales 
success, it was not thought desirable to continue the study of 
the relationship between social dominance and sales success. 
The personality inventories of these same individuals repre- 
sented in Table I were now scored by the other five methods 
proposed by Bernreuter, but none of the scores (B1—N, B2-S, 
B3-I, F1-C or F2-S) were any more successful in differen- 
tiating successful from unsuccessful salespeople. Does this 
indicate that no significant relationship exists between per- 
sonality as measured by the Bernreuter Personality Inventory 
and sales success or is it possible that such a relationship does 
exist in spite of the fact that none of the six Bernreuter scores 
indicate its existence? 

In order to investigate this question, the personality inven- 
tories of the individuals represented in Table I were analyzed 
item by item. Of the 125 items in the Bernreuter Personality 
Inventory, 62 were found in which there appeared to be a 
tendency for the best salespeople to give a response differing 
from the response of the poorest salespeople. A rough scoring 
system was therefore set up, by giving a score of one for each 
of these items where the response agreed with the response 
favored by the best salespeople. Table II indicates the results 
when this system of scoring was used. We must expect a high 
correlation between these scores and sales success because the 
personality inventories of these same individuals were used 
as the basis for determining the scoring system. However, the 
relationship seems to be even more striking than could be ex- 
pected as there is no overlapping between the scores of the 
best and poorest salespeople. All of the best salesmen obtained 
scores of 40 or above while all of the scores of the poorest 
salesmen were lower than this. Every one of the best sales- 
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TABLE II 
Personality Scores as Measured by a Rough Experimental Scoring Method 
BEST POOREST BEST POOREST 
SALESMEN SALESMEN SALESWOMEN SALESWOMEN 
‘49 39 46 35 
47 39 46 35 
46 36 45 33 
45 35 42 28 
45 34 39 28 
45 32 38 26 
42 30 38 26 
42 26 37 
eh ec. dem She 36 














women obtained scores higher than any of the poorest, 36 being 
the low score for the group of best saleswomen and 35 the high 
score for the poorest. 

In order to test the validity of this apparent relationship 
between score and sales success, a new group of salespeople was 
necessary. The 42 individuals remaining in the original group 
of 75 were, therefore, considered as a new group. None of 
these salespeople, it will be remembered, were considered as 
unusually good or unusually poor salespeople, but at the re- 

TABLE IIr 


Personality Scores of Salesmen as Measured by a Rough Experimental 
Scoring Method 








ABOVE AVERAGE AVERAGE BELOW AVERAGE 
43 45 38 
41 40 36 
41 39 33 
40 39 33 
40 ee oe 2 ee 
40 36 
40 33 
39 32 
35 32 
ee 30 sabi 
jean 26 tbe 
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quest of the writer, they were rated by the personnel manager 
in conference with department heads as above average, aver- 
age, or below average. Table III indicates the personality 
scores, by the experimental scoring system, of the above aver- 
age, average, and below average salesmen, and Table IV indi- 
cates the scores for the above average, average, and below 
average saleswomen. 








TABLE IV 
Personality Scores of Saleswomen as Measured by a Rough Experimental 
Scoring Method 
ABOVE AVERAGE AVERAGE BELOW AVERAGE 
38 42 43 
38 37 32 
36 36 31 
35 34 31 
33 32 29 
31 32 
nt 25 











Let us consider all scores below 40 unacceptable for men as 
is suggested by Table II and reject on that basis. We note 
from Table III that everyone of the below average salesmen 
would be rejected, all but two of the average, but only two of 
the nine above average salespeople. The differentiation be- 
tween the saleswomen is not so clear-cut. But, if we consider 
all scores below 36 unacceptable as is suggested by Table II, 
we note from Table IV that only one of the five below average 
saleswomen would be accepted on this basis, only three of the 
seven average saleswomen, and three of six above average. The 
correlation between sales success rating and score of the sales- 
men represented in Table III is +.60 + .09 and the corre- 
sponding correlation for the saleswomen, represented in Table 
IV, is +.36+ .14. The effectiveness of elimination on the 
basis of critical score and the coefficients of correlation indicated 
above seem rather remarkable especially when we consider : 

First, that the groups represented in Tables III and IV 
contain a very narrow range of sales success due to the elimi- 
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nation of the most successful and the least successful sales 
people, which would tend to materially reduce the coefficients 
of correlation. 

Second, that our methods of measuring personality are as 
yet in an experimental stage and probably much less valid 
than measures of intelligence. 

In view of the apparent relationship between sales success 
and personality as indicated by Tables III and IV, an attempt 
was made to improve upon the original scoring system by tak- 
ing into consideration not only the extreme groups but also the 
above average and below average groups. As a result of this 
new item by item analysis, a scoring system was set up by 
which responses favored by best and above average salespeople 
were weighed from one to six depending upon the amount of 
correlation found to exist between the favored response and 
the rating for sales success. On the basis of this revised scor- 
ing, a correlation of +.71 + .07 was obtained between score 
and sales success for the group of salesmen represented in 
Table III and a correlation of .39 + .14 for the saleswomen 
represented in Table IV. Also, the extreme groups remained 
differentiated without any overlapping as was true when the 
previous rough scoring system was used. 

This study suggests the existence of a significant relation- 
ship between sales success and personality. Popular opinion 
has always assumed this but proof of its existence must neces- 
sarily await satisfactory measures of personality. As pointed 
out by Lorge,* most of our present personality traits have been 
established by fiat and are practically meaningless until their 
true meaning has been established by experiment. Is it not 
possible that such measures of personality as sales personality, 
engineering personality, and teaching personality may be much 
more useful than measures of extroversion, social dominance, 
etc.? To argue that the former measures would not be satis- 
factory because of overlapping of traits is without point for 


8 Lorge, Irving. ‘‘ Personality Traits by Fiat,’’ Journal of Educa- 
tional Psychology, Vol. 26, p. 273-78. 
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neither are the latter traits free from overlapping. At least, 
it seems likely that once the successful sales personality has 
been established by experiment, a study of this personality in 
terms of extroversion and social dominance would be most 
helpful in giving meaning to these last-named traits. 

Link’s* studies seem to be a step in the right direction because 
he seems to be attempting to determine what is a successful 
personality. He uses the word ‘‘extroversion’’ in speaking of 
this successful personality but he makes it very clear that what 
he is attempting to measure is personality with respect to its 
degree of ‘‘social usefulness.’’ Is it possible to set up a measure 
of personality which is desirable for all people in all walks of 
life? This can only be answered by further study but it is 
interesting to note that there seems to be some agreement be- 
tween the items which Link found to be significant in his mea- 
sure of ‘‘extroversion’’ and the items found to be significant in 
this present study of successful sales personality. Link states 
that one of his most significant items is the question, ‘‘Do you 
greatly dislike having people give you advice?’’ The desirable 


answer is ‘‘no.’’ In our present study, the question, ‘‘Do you 
greatly dislike being told how you should do things?’’ was 
found to be one of the most significant. Eighty-nine per cent 
of the best salespeople answered ‘‘no,’’ and 73 per cent of the 
above average, while only 56 per cent of the below average and 
53 per cent of the poorest salespeople gave this answer. 


SUMMARY AND CONCLUSIONS 


1. This study confirms a tendency for salespeople to score high 
in social dominance (B4-D). 

2. This study indicates that a low positive correlation exists 
between sales success and social dominance, but too low to 
be of value in differentiating between good and poor sales- 
people. 


4Link, H.C. ‘‘A Test of Four Personality Traits of Adolescents,’’ 
Journal of Applied Psychology, Vol. 20, p. 527-34 (October, 1936). 
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3. By means of an item analysis of the answers of successful 
and unsuccessful salespeople to the questions included in 
the Bernreuter Personality Inventory, a crude scoring 
system was set up on the basis of which: 

(a) A comparatively high correlation was found to 
exist between scores and sales success of a new 
group of salespeople. 

(b) A eritical score differentiated rather effectively 
between the successful and unsuccessful sales- 
people of the new group. 

4. This study breaks away from the traditionally accepted 
traits, which have been established by fiat, in an attempt 
to determine what is the successful sales personality. 

5. In this breaking from tradition, it is similar to Link’s study 
and confirms some of his conclusions. 



























EFFECTS OF LEADING ON READABILITY 
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Lighting Research Laboratory, General Electric Company, 
Nela Park, Cleveland 


printed matter with readability yields little information 

of a practical nature for the guidance of the typog- 
rapher. In general, previous investigations’ in which speed 
of reading has been used as criterion of readability (legibility), 
indicate that leaded type is read somewhat more rapidly than 
close-set type. However, the differentials in speed of reading 
are unimpressive even for extreme differences in leading. On 
the other hand, introspective appraisals of readability usually 
indicate that close-set type is considerably more difficult to 
read than is leaded type. Although this opinion is almost 
unanimously held, there is no semblance of agreement as to the 
most desirable amount of leading for any given size or style 
of type. In general, it appears that leading is relatively less 
important than such factors as size and style of type, visual 
efficiency of the reader, quantity of light and quality of light- 
ing. Nevertheless it is a controllable variable involved in the 
critical visual task of reading and is of economic importance. 


A CRITICAL survey of available data relating leading of 


CRITERIA 


It is conceivable that even a small increase in speed of read- 
ing, and one which may not be considered of importance from 
the narrow viewpoint of rate of reading, may be indicative of a 
relatively large increase in ease of reading. For example, the 
results of an extensive research? show that the natural or 
normal rate of reading relatively large and well-printed type 

1 Superior numbers refer to references at end of article. 
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was increased only five per cent when the level of illumination 
was raised from 1 to 100 footcandles. However, it was also 
shown that the degree of nervous muscular tension developed 
as a result of the reading was markedly less under the higher 
level of illumination. This and other researches have led us to 
conclude that the symptoms of strain and fatigue are more 
responsive to changes in the physical characteristics of the 
visual task than are the mere mechanical or productive aspects 
of the performance of the task. In other words, production or 
rate of performing a seeing task is a rather insensitive and in- 
complete method of appraising the cost of seeing to the human 
seeing-machine. 

Since prolonged near-vision tasks such as reading are con- 
sidered relatively severe even when performed under favorable 
conditions, it may be assumed that a reduction in the effort 
expended in their performance is correspondingly important. 
Furthermore, in comparing ‘‘speed’’ and ‘‘effort’’ as criteria 
of readability, it follows that the interpretation of an increase 
in speed of reading is less obvious or direct than a reduction in 
effort on the part of the reader since such factors as perception 
and retention, at the various rates of reading, are not usually 
measured or considered. Therefore, criteria which pertain to 
the psychophysiological effects produced by reading*® are em- 
phasized in the present discussion. However, the criteria of 
speed of reading and characteristics of the eye-movements 
have been included in this investigation since (1) they may be 
measured with facility; and (2) because of the possibility of 
correlating such data with psychophysiological effects which 
are far more difficult to measure. 

Such considerations of the complexities of determining the 
influence of leading upon readability seem to justify the con- 
clusion that the specification of proper leading upon the basis 
of a single criterion is quite unjustifiable. Furthermore, this 
conclusion is supported by the rather disappointing experi- 
ences of typographers who have attempted to utilize data so 
obtained and interpreted as a guide for their practices. Recog- 
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nition of these difficulties has led us to use several diversified 
criteria which may be summarized and briefly described as 
follows : 


I. Maximum speed of reading under illumination levels of 
0.1 footeandle and 10 footcandles, respectively. These results 
were obtained by exposing the reading matter at constantly 
and automatically accelerating speeds until the point of inabil- 
ity to read was reached. In this case, the reading was ‘‘paced’’ 
by the apparatus. 

II. Normal or natural speed of reading. These results were 
obtained by counting the number of words read during a period 
of five minutes. 

III. Normal rate reading during periods in which an ap- 
proximately constant rhythm in reading was maintained for 
several lines of type. These data were obtained from electro- 
myograms of ocular muscle activity during reading. 

IV. Adductive stimulus of tolerance. These data were ob- 
tained by uniformly increasing the power of a pair of rotary 
prisms (placed before the right eye) until binocular vision 
became blurred. 


V. Frequency of the eyelid reflex. These data were obtained 
by counting the number of involuntary blinks which occurred 


during a given period. 

It will be noted that a systematic study of the introspective 
reports of the readers concerning the influence of leading upon 
readability was not included in this investigation. Our experi- 
ences have indicated that such data are not only ambiguous 
from a quantitative basis but also may lead to erroneous gen- 
eral conclusions. Illusions are inescapable and they may play 
an important part in such appraisals. The wide diversity of 
amounts of leading now in general use seems to be evidence of 
the experimental indefiniteness of introspective methods. 


THE TYPOGRAPHICAL SPECIMENS 


Chapters I to V inclusive of H. G. Wells’ The Outline of 
History were set in 10-point ‘‘Linotype Textype’’ and the 
chapters leaded as follows: solid-set, 1-point (1/72 inch) leaded, 
2-point leaded, 3-point leaded and 6-point leaded, respectively. 
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The latter amount of leading is considered extreme by typog- 
raphers for types of ordinary sizes. The length of the lines 
of print was 21 picas (3.5 inches) and the printing was done 
with (non-glossy) black ink upon an excellent grade of white 
(non-glossy) book paper. In general, it may be said that every 
possible effort was made to print the various specimens in a 
uniformly excellent manner. These samples were prepared 
through the courtesy of the Mergenthaler Linotype Company 
of Brooklyn, New York. A few lines from each are reproduced 
in actual size in Fig.1. It is possible that the appearance of the 
type is somewhat altered by the processes of reproduction. 
The character of the text-matter selected for experimental 
purposes obviously constitutes a variable of unknown impor- 
tance in researches of this kind. Our selection of The Outline 
of History was made in an effort to secure text-matter of uni- 
form interest and emotive value insofar as this is possible. 
Furthermore, it is recognized that the duration of the experi- 
mental periods of reading may be a variable of considerable 
importance; and that the same conclusions regarding the in- 
fluence of leading upon readability might not be obtained from 
relatively long and short periods of reading, respectively. 
Actually, sufficient copy was prepared to permit’ the subjects 
to read throughout the experimental period without repetition. 


EXPERIMENTAL TECHNIQUES AND RESULTS 

I. Maximum Speed of Reading. The so-called ‘‘paced’’ de- 
terminations of the maximum speed of reading were made with 
the use of a specially designed machine. The vopy was bent 
around a large concealed revolving drum whose speed of rota- 
tion could be automatically and uniformly accelerated or decel- 
erated by merely pressing an appropriate button once. In each 
case, the reading matter appeared in a horizontal slot which per- 
mitted four lines of type to be visible at all times. In order to 
simulate the usual printed page, the slot was surrounded by 
printed matter similar to that upon the drum. In operating 
the apparatus, it was usual for the subject to commence reading 











SOLID - SET 


Astronomers give us convincing reasons for supposing, 
that sun and earth and moon and all that system were 
then whirling about at a speed much greater than their 
speed to-day, and that at first our earth was a flaming 
thing upon which no life could live. They oblige us to 
believe that the sun, incandescent though it is, is now 
much cooler than it was, and that it spins more slowly 


1-POINT LEADED 

Let us, to take a simple instance, here consider the 
case of some little, furry, whity-brown animal living in 
a bitterly cold land which is usually under snow. Such 
individuals as have the thickest, whitest fur will be least 
hurt by the cold, less seen by their enemies, and less 
conspicuous as they seek their prey. Every mutation 
in that direction will be advantageous. The fur of this 


2-POINTS LEADED 
The Record of the Rocks is like a great book that has 
been carelessly misused. All its pages are torn, worn, 
and defaced, and many are altogether missing. The out- 
line of the story that-we sketch here has been pieced 
together slowly and painfully in an investigation that is 
still incomplete and still in progress. The Carboniferous 
3-POINTS LEADED 
Little projectiles of that sort are always striking us. 
They, come flying into our atmosphere and catch fire 
with the heat of their rush through the air and burn— 
the shooting stars. Most of these meteors are burnt to 
nothing before they reach the ground, but many have 
reached and continue to reach the earth. Some in our 


6-POINTS LEADED 

These were small changes to happen to a one-inch ball, 
circling at a distance of 322 yards from a flaming sun 
nine feet across, in the course of a few million years. 
They were changes an immortal astronomer in Neptune, 
watching the earth from age to age, would have found 


Figure 1. Ten-point ‘‘ Linotype Textype’’ set with five different degrees 
of leading. (Reproduced photographically to actual size.) 
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with the drum revolving at a speed at which the reading could 
readily be done. When a speed was reached at which reading 
just became impossible, the subject pressed a button which 
stopped the acceleration but allowed the drum to continue to 
revolve at a constant speed. However, some readers preferred 
to check this determination by permitting the drum to attain 
a speed considerably greater than that which permitted read- 
ing and then redetermine the maximum speed of reading with 
a decelerating speed of rotation. 

The individual results obtained by ten adult readers possess- 
ing so-called normal vision are presented in Fig. 2 and are rep- 
resented by the solid-line curves. Each plotted point represents 
the average of three separate measurements taken on each of 
five different days. The broken-line curve which is shown in 
each section of Fig. 2 represents the average of the data obtained 
by the ten readers. These measurements were made under an 
illumination-level of 10 footeandles of totally indirect lighting 
and a controlled reading-distance of 14 inches. The brightness 
of the surrounding visual field was moderately lower than the 


brightness of the printed matter. A statistical summary of the 
results is presented in Table I. 


TABLE I 
Average Maximum Speeds of Reading Obtained Under the Experimental 
Conditions for 10 Adult Subjects Possessing Reasonably 
Normal Vision 





POINTS OF LEADING 





1 2 3 





Words Per Minute 
Arithmetic Mean 567.00 | 551.00 | 561.00 | 554.00 | 564.00 
Geometric Mean 558.00 | 543.00 | 555.00 | 545.00 | 555.00 
Relative ... 100.00 | 97.20 | 98.80 | 97.60 | 99.30 

Probable Error, Words Per . 

3.20 4.50 5.60 7.60 5.40 

Probable Error, Per Cent 0.57 0.81 1.00 1.37 0.96 




















It will be noted from Table I that the maximum variation in 
average maximum speeds of reading is less than 3 per cent. 
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FieurE 2. The relationships between leading and speed of reading as determined by 
each of ten subjects are indicated by the solid lines. The broken line which appears in 
each section represents the average of the data obtained by the ten subjects. 
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Such a differential is not particularly reliable from the statis- 
tical viewpoint when it is compared with the corresponding 
probable error. In general, our results are in agreement with 
those obtained by Bentley* who employed a different technique 
in determining the maximum speed of reading. Bentley’s 
data (for 12-point type) read at various fixational distances, 
indicated that the type with 3 points of leading was read about 
3 per cent faster than was solid-set type. However, no further 
gain in speed of reading was observed by him when the leading 
was increased from 3 points to 6 points. When the leading 
was increased to 8 points, the speed of reading was reduced to 
about the same as that obtained with solid-set type; and with 
10 points of leading, a sharp decrease in speed of reading was 
obtained as might be expected. Furthermore, Bentley was 
unable to detect any influence of leading upon the accuracy of 
reading as appraised by the number of regressions, hesitations 
and mispronounced or misread words. 

It is evident from our data and those obtained by Bentley 
and others that the maximum speed of reading 10-point and 12- 
point types is not significantly influenced by the factor of 
leading when the latter is varied from zero to 6 points. Ob- 
viously, this conclusion may not be extended to include smaller 
types without further experimentation. It will be noted from 
Fig. 2 that individual subjects seem to react differently to the 
factor of leading. For example, the subjects may be grouped, 
as is done in Fig. 2, into three arbitrary classifications; those 
that read faster as the leading is increased, those that do not 
indicate any systematic trend and those that read slower as 
the leading in increased. Among the latter, one subject insisted 
that it required a ‘‘conscious effort’’ to transfer fixation from 
one line to the next in the case of the 6-point leading. 

Although the data indicate that the actual maximum speed 
of reading (words per minute) is influenced but little by 
changes in leading, the apparent or subjective speed of reading 
(progress down the page) obviously increases with the amount 
of leading. In other words, the reader must progress down the 
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page at a faster rate when reading leaded type than he does 
when reading solid-set type if the number of words read per 
minute is to be the same, or nearly so, in both cases. Then 
the relative apparent speeds of reading (lines per minute) 
would be 10, 11, 12, 13 and 16, respectively, for the five different 
amounts of leading used in the present investigation. Hence 
it is conceivable that the experience of reading more ‘‘lines’’ 
(but actually reading no more words) in a given time may be 
quite influential in the introspective appraisal of leading. It 
may be a factor in the general dislike of solid-set type. If this 
phenomenon exists, it is none the less important because of its 
psychological origin and typographers must be cognizant of it. 

In introspective appraisals of the relative desirability of 
printed matter of the same style and size of type but of differ- 
ent degrees of leading, it is well to be on the lookout for false 
impressions which may be produced by ever-present illusions. 
These are numberless and many are present in reading and in 
reading matter. A given leading may appear excessively de- 
sirable after reading close-set type or the latter may appear 
unduly undesirable after reading the former. One may detect 
these influences by reading the various samples in Fig. 1. It 
is also interesting to turn Fig. 1 upside down and study it. 
These specimens, reproduced to actual size, represent the mate- 
rial used in the researches described in this paper. We have 
already pointed out the possible illusion of reading faster due 
to progressing faster down the page in the case of high degrees 
of leading. These are merely examples of illusions involved. 
In the performance of seeing illusions are always present. In 
fact, it is likely that one never actually sees anything as it 
exists in purely physical measurements and relationship to 
other things. There is always something else seen even if it is 
nothing more than a formless unlimited background of different 
brightness. Beyond these types of illusions is the possible 
illusory effect of an esthetically desirable or undesirable printed 
page. Inasmuch as we are human, our attitude, performance 
and various reactions are influenced. The possibility of being 
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misled by illusions is an important reason for making measure- 
ments of various kinds. 

It is a fact in physiological optics that the effectiveness of a 
given visual factor may depend upon the difficulty of the seeing 
task. For example, we have shown that speed of reading in- 
creases decisively with increases in illumination when the type- 
face is difficult to read or when the contrast between the printed 
matter and its background is low.* Hence it might be expected 
that the influence of leading upon speed of reading would be 
more pronounced when the reading was made more difficult. 
This possibility was investigated by determining the relative 
speeds of reading under the extremely low level of illumination 
of 0.1 footeandle and a level of 10 footcandles. The results 
are presented in Fig. 3 for the same five subjects in each case. 
It will be noted that the speed of reading was about 20 per cent 
slower under the lower level of illumination but that no signifi- 
cant differences in the effects of leading were obtained in the 
two cases. 

The fact that a trend towards faster reading with leaded 
types is indicated in Fig. 3 is considered to depend largely 
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Fieure 3. The average speed of reading as determined by five subjects for two levels 

of illumination. These subjects were in the first two groups of Fig. 2. 
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upon the characteristics of these particular readers because 
they were in the upper two groups in Fig. 2. The important 
point is that no differences in the effect of leading were ob- 
tained under the two extremely different levels of illumination. 
Certainly, it is reasonable to assume that reading 10-point type 
under 0.1 of a footeandle constitutes a seeing task far more 
severe than would be tolerated in practice. Hence the results 
of this phase of the investigation further substantiate the con- 
clusion that leading is not an important influence upon the 
maximum speed of reading as measured in words per minute. 
It is emphasized that this conclusion is based upon experimental 
data which pertain to the reading of relatively large type (10- 
point) for short periods of time. It is possible that greater 
differentials in speed of reading would be obtained if the read- 
ing were prolonged for long periods. Elsewhere’ we have 
shown that definite symptoms of fatigue of ocular muscles may 
be observed and measured after an hour of continuous reading. 
The experimental investigation of this phase of the problem 
has not been attempted due to the lack of suitable reading 
matter, prepared with essential uniformity in all respects ex- 
cept leading, which would be adequate in quantity for pro- 
longed periods of reading. 

II. The Normal Speed of Reading. Previous experience in 
the measurement of speed of reading has shown that the normal 
rate of reading is increased relatively little when the reading 
is made easier, for example, by increasing the level of illumina- 
tion upon the printed matter over ranges far above the thresh- 
old. In such cases it appears that the subjects are inclined to 
take advantage of the more favorable conditions for seeing in 
lessening the effort expended, rather than in increasing the 
speed of reading. Thus the voluntary control of effort serves 
to obseure certain possible benefits derived from improved see- 
ing conditions. However, it has been established that the rate 
of reading corresponds to the difficulty of the seeing task when 
the latter is altered by means over which the subject has little 
or no voluntary control. Thus for a priori reasons, it seems 
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probable that the speed of normal reading would constitute a 
rather insensitive criterion of the influence of leading. How- 
ever, such a criterion possesses the advantage of being directly 
interpreted in practice from the viewpoint of productive 
efficiency. 

The data of Table II indicate that the normal rate of reading 
10-point type is not altered significantly by large changes in 
leading. It will be noted that the actual differences obtained 
are unimportant when compared to their corresponding prob- 


able errors. However, it appears that the trend of these data 
is similar to that of Figs. 2 and 6. 


TABLE Il 
The Average Normal Speeds of Reading as Determined by 23 Different 
Subjects Each of Whom Read Each Kind of Printed Matter on Two 
Different Occasions Under an Illumination of 5 Footcandles. 
The Duration of the Reading-periods was 
5 Minutes in All Cases 





POINTS OF LEADING 


e413 a hice he 








Relative Speed of Reading 100.0 98.8 99.6 | 100.8 | 101.1 
Probable Error 0.7 0.9 | 1.0 1.2 








Ill. Normal Speed of Reading During Periods of Rhythm. 
When the aetivity of the ocular muscles is recorded by means 
of the electromyograph, a conspicuous characteristic of the 
resultant tracing is the lack of regularity or rhythm in the 
reading, as will be noted from Fig. 4. Hence it is conceivable 
that the influences of the numerous variables present in the 
reading situation serve to obscure the possible influence of 
leading upon the speed of reading. This possibility was ex- 
perimentally investigated by determining the speed of reading 
during periods in which the rate of reading is approximately 
constant and the indicated ocular movements are fairly regular. 
Such periods are readily discerned by examining the elec- 
tromyograms obtained during the reading. It will be noted 
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Ficure 4. Electromyogram record of one minute of reading 10-point Linotype Text- 
type with two points of leading. The record reads from left to right with increasing time. 
The heavy lines above the tracings indicate seconds in time. A typical period of uniform 
reading is indicated at (A) on this record. 


from the data of Table III that the speed of reading was ap- 
proximately constant for all degrees of leading when measured 
in the manner described. 

IV. Adductive Stimulus Tolerance. The fact that the speed 
of reading is more or less independent of the factor of leading 
indicates that the former is not limited by the ocular functions 
when 10-point type is read for relatively short periods of time 
by subjects possessing normal vision. The validity of this 
conclusion has been tested further by determining the prismatic 
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TABLE III 
The Normal Rates of Reading During Periods of More or Less Uniform 
Performance as Determined from the Results of 6 Subjects. In 
Obtaining the Electromyograms, the Electrodes Were Placed 
Directly Above the Right Eye and at the Right 
Temple, Respectively 




















POINTS OF LEADING 

0 1 2 | 3 6 
Relative Speed of Reading ....... | 100.0 93.6 99.9 | 102.1 | 105.6 
Pee ks ee PN 2.0 1.6 2.1 2.9 











power required to blur the retinal image while reading types 
involving various amounts of leading. Since the movements 
of the extrinsic muscles of the eyes are a function of the inter- 
linear space in reading, it is conceivable that variations in the 
latter might be related to the amount of prismatic power re- 
quired to blur the retinal image. In the experimental pro- 
cedure, a pair of motor-driven rotary prisms was placed before 
the right eye of the subject who binocularly fixated the reading 
matter at a distance of 14 inches. While the subject was read- 
ing the resultant power of the combined rotary prisms was 
gradually and uniformly increased until the blur-condition 
was reached. 

The results obtained from seven subjects indicated that the 
amount of adductive stimulation which could be tolerated with- 
out blur did not depend upon the degree of leading of the type 
used in the investigation. However, it is conceivable that this 
criterion might reveal differences for various degrees of leading 
if the eyes were previously fatigued by long periods of reading. 

V. Frequency of the Eyelid Reflex. It follows from the 
foregoing considerations that the appraisal of the relative in- 
fluence of various degrees of leading upon readability would be 
difficult or impossible if the analysis were based only upon 
measurements of speed of reading and the introspective reports 
of readers. On the one hand, measurements of speed and 
accuracy of reading indicate that leading is a relatively unim- 
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portant typographical factor ; while on the other, the introspec- 
tive reports are in opposition to such a conclusion. This situa- 
tion illustrates the distinction which we have made between 
vision and seeing.’ The former is associated rather narrowly 
with visual functions but the latter includes the complete series 
of events beginning with the stimulus and ending in human 
behavior and efficiency. It is not surprising to find that cer- 
tain phases of this complex chain of events are not significantly 
influenced by the factor of leading. However, if it can be 
shown that the introspective reports of the subjects are in 
qualitative agreement with measurable psychophysiological . 
effects, the significance of the introspective data is considerably 
enhanced. Furthermore, such measurements would provide 
a quantitative basis for appraising the relative significance of 
various amounts of leading. 

The conclusions of Ponder and Kennedy that ‘‘the rate of 
blinking is closely related to the mental tension of the subject 
at the time and that the movements constitute a kind of relief 
mechanism whereby nervous energy, otherwise unutilized, 
passes into a highly facilitated path’’ suggested the possibility 
that this phenomenon might serve as an adequate or appropri- 
ate criterion for measuring certain effects of performing the 
task of seeing. The results obtained by the authors,* in using 
this criterion in other researches, indicate that it is one of 
unusually high sensitivity to physical changes in the stimulus. 
These results will be reviewed briefly as a means of indicating 
the significance of the frequency of the eyelid reflex as a cri- 
terion of ‘‘ease’’ in seeing and of readability of print. 

We have shown elsewhere’ that the following changes in the 
visual situation increase the rate of blinking— 


An increase in the duration of the period of reading. 

A decrease in the size of the type read. 

The use of improper eyeglasses while reading. 

The addition of a glare-source within the visual field. 

A decrease in the level of illumination upon the reading 
matter. 
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It is obvious that these changes in the visual situation are un- 
favorable ones from the viewpoints of clear and easy seeing. 
The actual experimental results obtained under these condi- 


VARIABLE FREQUENCY OF EYELID REFLEX WHILE READING 
PER CENT 
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tions are shown in Fig. 5. It will be noted, for example, that 
the rate of blinking is much greater when the reading was done 
under one footeandle than it is under 100 footeandles. We 
have also shown* that nervous muscular tension and fatigue in 
the extrinsic ocular muscles is also greater, and that the heart- 
rate is lower, when the reading is done under relatively low 
levels of illumination than under higher levels. Thus it may 
be concluded that the rate of blinking is intimately related to 
important psychophysiological effects of seeing. As such, it 
may be assumed that it is an appropriate criterion for the 
appraisal of leading upon readability. 

The data of Table IV show the relative rates of blinking when 
reading copy set in 10-point Linotype Textype with five differ- 
ent amounts of leading. These data represent the averages of 
the results of thirty different subjects, each of whom read the 
five samples of copy on two different occasions. The sequence 
in which the copy was read was reversed in the second reading 
in order to minimize the possible progressive effects of fatigue 
during the experimental period. The latter involved reading 
each kind of printed matter for a period of 5 minutes under 
an illumination of 5 footeandles. Thus the reading-tasks were 
relatively short in duration and were performed under condi- 
tions comparable to those often encountered in practice. Fur- 
thermore, the subjects were instructed to read at their natural 
rates and at their normal or customary fixational-distances. 
No attempt was made to keep the latter exactly constant dur- 
ing the various phases of this part of the investigation. 


TABLE IV 
The Geometric Mean Rates of Blinking as Determined from Observations 
Involving 30 Adult Subjects 














POINTS OF LEADING 
0 | 1 2 3 | 6 
Relative Rate of Blinking ......... 100.0 | 99.6 | 90.3 | 84.1 | 81.2 
PM NE vac coancdcccrclbnnsiin Ass Geeniacnioed J 2.3 2.2 2.6 
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The experimental results are plotted in Fig. 6. In general, 
it will be noted that the rate of blinking was the greatest for 
the solid-set and the 1-point leaded types; that the rate of 
blinking decreases rather sharply as the leading is increased 
from 1 to 3 points; and that the changes in the rate of blinking 
are relatively small when the leading is increased from 3 to 6 
points. It is possible that the minimum rate of blinking occurs 
with a leading greater than 3 points and less than 6 points but 
the data of Fig. 6 indicate that the reduction in the rate of 
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FieurE 6. The relative rate of blinking while reading print with various degrees of lead- 


ing as determined by thirty subjects. 


blinking for any leading greater than 3 points would be rela- 
tively small, and therefore, of little practical significance. 
Thus it may be concluded from these data that 3-point leading 
represents an approximate optimum in readability of 10-point 
type (21 picas measure) as appraised by the comprehensive 
criterion of the reflex blink. However, it should not be as- 
sumed that this optimum holds for radically different sizes and 
styles of type. 

It is of interest.to note that the criteria of speed of reading 
(Fig. 2) and rate of blinking (Fig. 6) indicate that readability 
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is not improved by a change from solid-set to 1-point leaded 
type. In view of the fact that a spacing of one point subtends 
a visual angle of 3.4 minutes and that one can generally deter- 
mine which of two objects is being fixated when the objects are 
separated by as little as one minute of visual angle, it is some- 
what surprising that no appreciable difference between solid- 
set and 1-point leaded type was detected by the ériteria used. 
Thus it appears that the influence of leading is not determined 
primarily by the abilities of the visual sense but rather by fac- 
tors of distraction and confusion in the perceptual phases of 
seeing. 

The data of Fig. 6 show that the average rate of blinking is 
decreased about 19 per cent when the leading is increased from 
1 to 3 points. In estimating the practical significance of this 
reduction in the rate of blinking, it is helpful to refer to Fig. 
5. In particular, it will be noted that increasing the size of the 
type from 6 points to 12 points, decreased the rate of blinking 
by about 33 per cent. These data were obtained from eighteen 
subjects while reading for 5-minute periods under conditions 
similar to those of the present research. Thus a change of 6 
points in type-size altered the rate of blinking about twice as 
much as did an increase in the leading of 10-point type from 
1 to 3 points. Therefore, the effect of the change in leading 
upon readability is obviously important. However, it is em- 
phasized that this comparison of the effects of type-size and 
leading is significant only in a qualitative sense since some but 
not all visual phenomena are appraised in each case. For ex- 
ample, an increase in type-size not only decreases the rate of 
blinking but also increases the visibility® of the printed matter ; 
while a change in leading does not alter the latter to an appre- 
ciable degree. 


SUMMARY AND CONCLUSIONS 


If reading is considered merely as a mechanical task, it fol- 
lows from numerous investigations, including the present one, 
that leading is not a critical typographical factor since it has 
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little effect upon the rapidity and accuracy of performing the 
task of reading. It would seem obvious that such a viewpoint 
is inadequate and unjustifiable. Yet, it has been tacitly ac- 
cepted in most laboratory appraisals of the relative importance 
of various degrees of leading by behavioristic methods. How- 
ever, if the reader is considered as a human seeing-machine 
which reacts to distractions, is annoyed by them and experi- 
ences strain and fatigue, the influence of leading becomes real 
and significant. Thus the reader expresses a dislike for solid- 
set type and measurements of the psychophysiological effects 
of reading such type indicate that it is undesirable. In gen- 
eral, the typographer has been guided by mass experience in 
reading and thus has escaped the pitfalls involved in restricted 
methods of experimentation. As a result, he appreciates the 
importance of leading in a qualitative manner but is rather un- 
certain regarding the relative influence of various degrees of 
leading upon readability. In various ways we have previously 
shown’ that the production of useful work done is not an ade- 
quate or appropriate measure of the cost of seeing to the human 
being operating as a human seeing-machine. 

It has been shown that the frequency of the reflex blink de- 
creases when conditions for seeing are made more favorable by 
various means such as more light, better lighting, larger type, 
proper eyeglasses and absence of preventable glare. Using the 
frequency of blinking as a criterion of readability, as the latter 
is influenced by various degrees of leading, it has been shown 
that for 10-point Linotype Textype ; 


1. Both solid-set and 1-point leading are about equal in read- 
ability and are the least desirable ; 

2. Readability increases significantly as the leading is 
increased beyond one point; and 

3. Three-point leading represents a practical optimum in 
readability. 


These conclusions are based upon the concept of seeing as an 
activity of the human seeing-machine and involve considera- 
tions of both efficiency and comfort in reading. It is recog- 
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nized that the appearance of the printed page is an esthetic 
factor which might influence introspective appraisals and that 
the degree of leading indicated by introspective opinion may 
or may not be in agreement with that indicated by physiological 
criteria. However, it is likely that ease in reading will exert 
appreciable influence upon esthetic appraisals when superficial 
prejudices are absent. 

The authors acknowledge their indebtedness to Mr. 8. K. 
Guth and Mr. A. A. Eastman for their part in accumulating 
these data and to the Mergenthaler Linotype Company of 
Brooklyn, New York, for their painstaking preparation of the 
printed material used in the experimental work. 
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A COMPARISON OF WOMEN STUDENTS 
PREPARING FOR THREE DIFFER- 
ENT VOCATIONS 


ALICE I. BRYAN! anp RUTH E. PERL 
Pratt Institute 


OCATIONAL choices at the college level are usually 
based, at least in part, upon special interests and apti- 
tudes. When a candidate for admission to a profes- 

sional school of high standing has successfully met the entrance 
requirements, it may be assumed that he rates above average, 
not only in general intelligence, but in the special abilities con- 
sidered essential by that school for success in the type of work 
chosen. Beyond this immediate assumption, however, lies the 
question as to whether there exist any fundamental differences 
in basic characteristics of mental endowment in groups of 
students who select different vocational fields and succeed in 
enrolling in professional schools preparing for these fields. 

The question then arises as to whether such differences, if 
found to exist, are affected by the specialized vocational training 
undergone by students who have been admitted to a particular 
professional school. If so, there remains the question as to 
whether such changes may differ in kind or degree with differ- 
ent types of vocational training. 

In order to obtain data which would throw some light upon 
these questions and help point the way for subsequent studies, 
an analysis was undertaken of various abilities which might, 
according to the degree possessed, differentiate groups of stu- 
dents in three different types of professional schools, namely : 
Art, Music, and-Teacher Training. This study was limited to 


1 Head, Dept. Psychology, School of Fine and Applied Arts, Pratt Insti- 
tute, Brooklyn, N. Y. 
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female students in order to rule out the factor of possible sex 
differences. 

The institutions chosen for study were: (1) School of Fine 
and Applied Arts, Pratt Institute, Brooklyn, N. Y., (2) Insti- 
tute of Musical Arts, Julliard Foundation, New York City, and 
(3) New College (an undergraduate institution for teacher 
training), Teachers College, Columbia University, New York 
City. These schools were chosen because each is outstanding 
in its field and because the subjects drawn from them were 
comparable in many respects. Thus, all three schools require 
a high school diploma for admission. Both Pratt Institute and 
the Institute of Musical Arts give aptitude tests in their special 
fields as a further basis for admission. New College gives no 
special aptitude tests, but each student is carefully studied 
before admission and an attempt is made to select only those 
whose previous records and activities indicate promise of suc- 
cess in the teaching profession. All three schools have an 
excess of applicants. Pratt accepts about one from every 
four making application, the Institute of Musical Arts accepts 
about 50 per cent of its applicants, and New College limits its 
enrollment to those applicants who meet its standards. 

Our subjects were divided into two groups: (1) all female 
students in each school who were in their first term of profes- 
sional training, and (2) all female students in each school who 
were in their third or fourth years of training. The only stu- 
dents who were excluded from these groups were extreme age 
deviates and students who had undergone any type of formal 
training between graduation from high school and admission to 
these professional schools. Our experimental groups contained 
the following numbers of students: 














PRATT a NEW COLLEGE 
» | OS Bae, ES 89 47 83 
Year III & IV ....... 61 23 27 





The following battery of tests was administered to all of 
these students : 
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1. The American Council on Education Psychological Ex- 
amination, 1934 Edition (including five sub-tests, namely, Com- 
pletion, Arithmetic, Artificial Language, Analogies, and Oppo- 
sites). 

2. ‘three tests of rote memory, namely, memory for visually 
presented objects, words, and digits. 

3. A motor speed test, in which the subject was required to 
make rows of little gates (four lines down and one across as in 
tallying) with her pencil on a sheet of lined paper. 

4. The Bernreuter Personality Inventory (scored for neu- 
rotic tendency). 

The American Council on Education Psychological Examina- 
tion and the Bernreuter Personality Inventory are well stand- 
ardized and familiar to all psychologists, but the other tests 
require some description. The test of memory for visually pre- 
sented objects was given in two parts, each part consisting of 
fifteen small familiar objects attached to a white cardboard 
background and exposed for 14 minutes. At the end of that 
time the cardboard was removed from view and the subjects 
made a list of all of. the objects they could remember. A 
reliability measure for this test, based on the scores of 78 sub- 
jects, was computed by correlating the scores made on the two 
parts of the test and correcting by the Spearman Brown 
prophecy formula. It was .70. The score on this test was the 
total number of objects correctly remembered on both parts 
of the test. © 

The test of memory for visually presented words was also 
given in two parts. Each part consisted of twenty white cards 
on each of which was lettered in black a different four-letter 
noun. These cards were presented in serial order with a five 
second exposure for each. After all twenty words had been 
shown, the subjects were required to list all words remembered. 
The score was the sum of all words correctly remembered on 
both parts of the test. A measure of reliability was computed 
by the same method as for memory of objects. For a sample of 
78 subjects, a reliability of .90 was obtained. 

The test of memory for visually presented digits was a span 
test in which series of numbers, lettered in black on white cards, 
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were presented visually. This test was also given in two 
equivalent parts and the score was the average of the largest 
number of digits correctly recorded in each set. By the split 
half method we found a reliability of .68 for this test. Al- 
though the digit span test is considered valuable and is often 
used, a low reliability is usually obtained for homogeneous 
groups because of the lack of scatter of the scores. 

The motor speed test was a paper and pencil test in which 
the subjects were required to make rows of ‘‘gates.’’ This test 
is described by Perl in ‘‘The Effects of Practice upon Indi- 
vidual Differences,’’ Arch. Psychol. No. 159, 1933. For groups 
of elementary school children she found reliabilities in the .70’s. 
These were obtained by correlating the sum of scores made in 
the first and third quarters of the time period with the sum of 
scores made in the second and fourth quarters. 

The results of this testing program are presented in Table I, 
which shows the mean scores for each group on every test. It 
will be noted that the scores on the American Council Psycho- 
logical Examination are all equal to or above the median for 
college freshmen, the lowest mean (170.57) being equivalent 
to a percentile rating of .489, while the highest (220.93) is 
equivalent to a percentile rating of .771. The third year 
groups are superior to the first year, except at Pratt where the 
mean for the first year students is fifteen points higher than 
that of the third year group. 

On the Bernreuter Personality Inventory, which was scored 
for neurotic tendency, the Pratt first and third year scores are 
equivalent to the 56th and 47th percentiles respectively; the 
Institute of Musical Arts scores are equivalent to the 65th and 
54th percentiles; and the New College scores to the 39th and 
35th percentiles respectively. (A percentile score of .56, for 
example, indicates that this group has a mean score for neu- 
rotic tendency which is higher than 56 per cent and lower than 
44 per cent of the scores made by the large group of college 
women with whom they are being compared.) These results 
indicate that the first year Pratt students and both groups of 
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the Musical Arts students are more neurotic than the average 
college woman. Both groups of the New College students are 
less neurotic than the average. In all three schools, the third 
year groups show less neurotic tendency than the first year 
groups. 

The significance of the differences found between the first and 
third year groups in each school on each test are given in 
Table II. This table also shows the significance of the differ- 
ences between the first year groups in the three different schools 
and between the third year groups in the three schools. The 
differences that appear between the first and third year groups 
within each school are for the most part not very significant. 
At Pratt, however, the third year students are reliably superior 
to the first year group on the Memory for Objects Test, and 
they show a reliable and marked superiority in the Motor Speed 
Test. The third year students at the Institute of Musical Arts 
show a fairly reliable superiority on the Memory for Objects 
Test. At New College, the only significant difference is on the 
Completion Test, where the third year group shows marked 
superiority as compared with the first year students. 


TABLE I 
Mean Scores on all Tests 




















PRATT INST, MUS. ARTS NEW COLLEGE 
TEST 

I Ill I Ill I III 
Amer, Council .. | 185.50 | 170.57 | 173,90 | 176.30 | 207.65 | 220.93 
Completion ....... 32.75 34.20 34.40 32.95 38.70 45.10 
Arithmetic ........... 24.53 20.94 17.91 20.52 25.62 27.60 
Artif. Lang. ....... 38.97 32.25 41.10 44.00 51.45 52.75 
Analogies .............. 36.91 31.35 29.40 24.45 34.17 34.50 
Opposites ........ 53.74 53.75 52.60 55.55 60.10 64.15 
Objects ................... 15.13 22.96 18.82 21.18 21.19 21.00 
, i, PCE ae 21.59 21.22 24.20 23.00 22.88 20.70 
SID Docenitcovostiicis 7.70 7.58 7.66 7.82 7.45 7.75 
— 77.05 84.65 95.90 97.95 89.55 90.45 
Bernreuter .......... — 29.38 | - 45.00 | —- 16.40 | —32.26 | - 65.00 | - 75.92 














The differences between the comparable groups of students 
in the three different professional schools appear to be much 
more significant and meaningful. Summarizing the differ- 
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TABLE II 
Significance of Differences (D/oD)** 





ist & 3RD YEAR 

















1sT YEAR 3RD YEAR 
onia ye ah Rig GROUPS COMPARED | GROUPS COMPARED 

pe M* N* P&M | P&N | M&N| P&M| P&N | M&N 

Amer. Coun 
es ae -1.9 2 1.4 | -14 3.1 3.6 5 5.0 3.7 
Completion 8 -.7 3.0 8 3.4 2.0 -.6 4.9 5.4 
Ari tic -2.0 1.0 9 | -3.6 6 3.7 -.2 3.0 2.7 
Artif. -2.7 6 A Jt 3.5 3.6 2.7 5.8 1.8 
Analogies ..... 2.6 | -1.5 2) -3.8 | -1.6 2.3 | -2.0 1.2 2.9 
pram 0 a!) 15 -4 3.0 2.8 6 3.5 2.7 
Objects 13.7 2.8 -3 5.4 | 11.0 3.6 | -2.3 | -3.2 -.2 
Words .. -6 | -1.6 | -2.5 3.7 2.1 | -1.8 2.7 ~.6 | -2.7 
Digits .............. -9 6 1.5 | -2.0 | -1.8 | -1.1 1.0 9 -.3 
Speed ......... 3.0 5 3 7.5 5.9 | -2.6 3.5 1.9 | -1.9 
Bernreuter -1.2 -.8 -7 9 | -2.9 | -3.3 .7 | -1.7 | -2.1 























* P indicates Pratt; M, Institute of Musical Arts; N, New College. 

** In the comparisons between the Ist and 3rd year groups within each 
school, the value is positive when the 3rd year group is superior, and 
negative when it is inferior to the lst year group. In the comparisons 
between the 1st and the 3rd year groups of the three different schools, the 
values are positive when the second school of a given pair is superior, and 
negative when it is inferior to the first school. 


ences which are statistically reliable and which appear con- 
sistently in both the first and third year groups, we find the 
following : 

1. Students at New College are superior to those at Pratt on 
the American Council test as a whole and on the Completion, 
Artificial Language, and Opposites sub-tests. 

2. Students at New College are superior to those at the 
Institute of Musical Arts on the American Council test as a 
whole and on Arithmetic and Opposite sub-tests. 

3. Students at the Institute of Musical Arts are superior to 
those at Pratt in Memory for Words and in Motor Speed. 

Statistically reliable superiority of one school over both of 
the others appears in the following instances : 

1. New College first year students are superior to the first 
year students in both other schools on the American Council 
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test as a whole, on Artificial Language and Opposites sub-tests, 
on Memory for Objects, and on Bernreuter (less neurotic ten- 
dency). 

2. In the third year New College is superior to both the others 
on the American Council as a whole and on Completion, Arith- 
metic, and Opposite sub-tests. 

3. In the first year the Institute of Musical Arts is superior 
to the other two in Motor Speed. 

4. In the third year the Institute of Musical Arts is superior 
to both schools in Memory for Words. 

Although the differences are not statistically reliable in both 
instances but only in one, we might also note the following: 

1. New College first year is superior to both other first year 
groups in Completion and Arithmetic; and New College third 
year to both other third year groups in Analogies and Artificial 
Language. New College is superior to Pratt in both years in 
Arithmetic, Motor Speed, and Bernreuter ; and superior to the 
Institute of Musical Arts in both years on Completion, Artificial 
Language, Analogies, and Bernreuter. 

2. The Institute of Musical Arts first year is superior to both 
other first year groups on Memory for Words; and in the third 
year is superior to both in Motor Speed. The Institute of 
Musical Arts is also superior to Pratt in both the first and third 
year groups on Artificial Language. 

3. Pratt Institute first year group is superior to both other 
first year groups on Analogies ; and in the third year is superior 
to both other groups on Memory for Objects. Pratt is also 
superior to the Institute of Musical Arts in both years in Arith- 
metic and Analogies. 

The general trend of these results indicates that women who 
are studying at Pratt Institute to become artists show superior- 
ity, as measured by these tests, in spatial Analogies and Memory 
for Objects. Girls studying at the Institute of Musical Arts 
to become musicians have a better memory for words and 
superior motor speed of the type here tested. Women students 
preparing at New College to become teachers have higher intel- 
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ligence ratings and are definitely less neurotic than those study- 
ing to be artists or musicians. 

These results lend themselves logically to interpretation on 
the basis of abilities which might have been expected to be 
present in these three groups of subjects. Thus, within the 
limits of these tests, the student teachers excel in general intel- 
lectual ability and show themselves to be more stable emotion- 
ally. The art students seem to be superior in the ability to 
visualize spatial relationships and to remember objects. The 
music students are superior in motor quickness and in memory 
for verbal material. Apparently the degree to which these 
abilities are present does have some determining influence on 
vocational choice and also upon success in gaining entrance to 
a specific type of professional school. 

In conclusion, we might state that our results suggest that 
there are definite fundamental differences in basic mental char- 
acteristics among groups of students who choose different voca- 
tional fields and who gain admission to recognized professional 
schools in those fields. First and third year students in the 
same school also show some differences, but whether these are 
due to training, or to selection, or are merely accidental factors 
resulting from the fact that the classes tested were composed of 
different individuals, cannot be determined until the same 
individuals are tested in their first and also in their third years. 





INTELLIGENCE DIFFERENCES IN REACTION 
TO ADVERTISEMENTS’ 


NAOMI SCHILLER 
Long Island University 


HE numerous studies in advertising psychology that 

have been conducted to date deal almost exclusively 

with various factors involved in the construction and 
placement of the advertisement itself. Investigators seem to 
have neglected, comparatively, the influence of biological and 
social differences in the individuals to whom the advertisement 
is addressed. Although sex differences in reaction to adver-. 
tisements have been studied to a fairly large extent, age and 
occupational differenees have been barely touched, and intelli- 
gence differences have not been investigated at all. It is with 
the last-named factor that this paper deals. The study re- 
ported here was conducted to determine whether individuals 
of different grades of intelligence differ in their reactions to 
advertisements, and to discover what lines such intelligence 
differences follow, if they do exist. 

The writer asked forty-six children, all in the third term of 
high school,” to rate forty-eight advertisements. The children 
were selected as subjects on the basis of their intelligence scores 
on Form A of the Henmon-Nelson Tests of Menial Ability, only 
those whose scores agreed closely with their ratings in school 
work and with their performance on the Terman Intelligence 
Test (determined in junior high school) being considered 


1 The writer is deeply indebted to Dr. Richard H. Paynter, of Long 
Island University, and Dr. Gregory H. 8. Razran, of Columbia University, 
for their assistance. 

2 Students of the Eastern District High School, New York City, acted 
as subjects, through the courtesy of Dr. Frederick W. Oswald, Principal, 
and Mr. Abraham N. Gordon, Grade Adviser. 


169 





et I LR RE RTF in 








170 NAOMI SCHILLER 


eligible. Those highest in intelligence, those lowest, and those 
most nearly ‘‘average’’ in the class were finally picked. IQ’s 
in the high group ranged between 129 and 150; in the average 
group between 100 and 110; and in the low group between 74 
and 93. There were nineteen in the high group, with the 
group’s average intelligence at 135; fifteen in the average 
group, with the group’s average intelligence at 104.5; and 
twelve in the low group, with the average intelligence at 83. 

The advertisements were taken from several issues of Col- 
lier’s and The Saturday Evening Post. Some were chosen as 
exemplifying certain factors in advertising, such as the use of 
humor; others were picked more or less at random. All forty- 
eight advertisements were spread out on several long tables. 
Each child was given a sheet of paper, numbered at the side 
from one to forty-eight, and the rest of the paper divided into 
five columns, at the head of which, in this order, were: ‘‘ Ex- 
cellent,’’ ‘‘Good,’’ ‘‘ Medium,’’ ‘‘Poor,’’ ‘‘Terrible.’’ The ad- 
vertisements on the tables were likewise marked from one to 
forty-eight. The subjects were instructed to examine each 
advertisement as long as they pleased, and to mark those that 
they liked very much ‘‘ Excellent’’ by means of a check next to 
the number of the advertisement in the ‘‘ Excellent’’ column; 
to mark those that they liked a little less by means of a check 
in the ‘‘Good’’ column, ete. 

The number of subjects in each intelligence group consider- 
ing each advertisement to be excellent, good, medium, etc., was 
found by adding together all the check ratings in each group. 
On the basis of the number judging each advertisement, in 
each group, percentage ratings were obtained, giving the per- 
centage of each group that considered each advertisement ex- 
cellent, good, ete. Each percentage of ‘‘Excellent’’ for each 
advertisement was then multiplied by five; each percentage of 
**Good’’ by four; of ‘‘Medium’’ by three; of ‘‘Poor’’ by two; 
and of ‘‘Terrible’’ by one, and all the partial scores thus ob- 
tained for each advertisement were then added to give the 
numerical score of the advertisement within the particular 
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intelligence group. On the basis of the numerical ratings of 
the advertisements as given by each of the three groups, the 
rank order of all the advertisements as given by each of the 
groups was found. 

By the use of the rank order coefficient formula, p=1- 

2 . 

aa ay in which D is the difference between the positions 
of the advertisement in the two groups being compared at a 
time, and » is the number of cases,* the correlations between 
the judgments of the three groups were found to be as follows: 


Correlations between Intelligence Groups 





Average and High Group 0... .73 
Average and Low Group 75 
high amd Low Group ..c.ccccccccccssisssseennsneeneenee 58 


Obviously, then, the different groups differ in their reactions 
to an advertisement as a whole, the disparity in their judg- 
ments increasing as the intelligence difference increases. 

To find what intelligence differences exist in judgments of 
specific features in advertisements, the advertisements used in 
this study were placed into several non-mutually-exclusive 
categories, such as ‘‘eclor,’’ ‘‘humor,’’ ‘‘much copy,’’ “‘little 
copy,’’ ete., and the reactions to a particular category on the 
part of one of the intelligence groups checked against the reac- 
tions to the same category on the part of the other two groups. 

The results are summarized in the table below. The lower 
the figure stated, the higher was the ranking given by the 
group. The figures show that there are definite IQ differences 
in reaction to specific factors in an advertisement as well as in 
reaction to the advertisement as a whole. 

There were 26 advertisements in color and 24 in black and 
white. It can readily be seen from the table that while all 
three groups preferred the color to the non-color advertise- 
ments, with increase in intelligence of the group judging, the 

8 N refers to the number of advertisements. The formula as used here 
does not take into account the number of subjects, and on that account the 


writer found it impossible to determine the statistical reliability of the 
results without entirely revising her treatment of the data. 
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Average Rank of Advertisements in Each Classification as Given 
by the Three Intelligence Groups 



































AVERAGE RANK 
NUM- Low Average High 
BER Group Grou Group 
(12 su (15 sui (19 sub- 
jects) jects) jects) 
Ads in Color 26 19.0 20.6 21.8 
Ads in Black & White ................. 24 30.9 29.0 27.6 
Difference 11.9 8.4 5.8 
Ads with Pictures of People... 27 24.4 22.6 20.5 
Ads with Pictures of Objects 18 28.0 30.6 33.7 
Difference 3.6 8.0 13.2 
Humorous Ads. .. 3 35.0 25.3 15.7 
Ads with Much Copy .................... 3 46.4 42.0 36.0 
Ads Largely Picture ................. 21 28.5 27.0 25.9 
Difference 17.9 15.0 10.1 
Positive Appeal o..ccecccccsmsesse 1 26.0 3.5 4.5 
Negative Appeal ccc 1 25.0 41.0 14.5 
Difference 1.0 37.5 10.5 




















difference between the average ratings given the color and the 
non-color advertisements decreased. This would seem to show 
that, the more intelligent the group, the less responsive it was 
to the factor of color, in itself. The figures given in the table 
represent the average judgment of each of the three groups 
with respect to all the color and all the non-color advertise- 
ments taken at once. Interestingly enough, however, the fol- 
lowing figures were obtained with respect to two single adver- 
tisements which were identical in all respects except that one 
was in color and the other was not: 

















RANK 

Low Group ben | High Group 
Mile... 22.5 155 . | \ 27.0 
Ad in Black & White ........... 11.0 25.5 39.0 
Difference ~11.5 10.0 12.0 





These figures for the two single advertisements form the only 
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exception to the general trend of the figures which give the 
average ranking of all the color advertisements taken together, 
and of all the non-color advertisements taken together. 

It will be noticed that the judgments of the average and high 
groups with respect to these two single advertisements do not 
differ markedly from their average judgments of all the color 
and all the non-color advertisements taken together. It is only 
in the case of the low group that a marked reversal of judg- 
ment seems to occur. Whereas in the low group’s average 
judgment of all the color and all the non-color advertisements 
taken together the color advertisements are greatly preferred, 
with a difference of 11.9, in the ease of the isolated two adver- 
tisements the non-color advertisement is preferred, with a 
difference of 11.5. Most likely, there was some feature of the 
single advertisement in color that was particularly displeasing 
to the low group, and upon which the group rated the adver- 
tisement, rather than upon the color factor. 

Of all the picture-containing advertisements, both in color 
and in black and white, 27 contained pictures of people and 
animate beings and 18 contained only pictures of objects. 
While all three groups ranked the advertisements with pictures 
of people higher than those with pictures of objects, the more 
intelligent the group judging, the greater was the superiority 
of the advertisements with pictures of people over those with 
pictures of objects. 

The three humorous advertisements included in the study 
evoked a more favorable response from the high than from the 
average, and from the average than from the low, intelligence 
group. With increase in IQ of the group judging, humor in 
advertisements was more favorably received. 

When the reactions of the three intelligence groups to those 
advertisements consisting entirely or almost entirely of copy, 
(three in number, all in black and white) were compared ‘with 
their reactions to those black and white advertisements con- 
sisting largely of pictures (21 in number), it was found that 
the advertisements which were largely picture were favored 
above the copy advertisements by all three groups, but that 
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they had a decreasing advantage over the largely-copy adver- 
tisements with increase in intelligence of the group judging. 

Two advertisements by the same company, alike as to layout, 
size of picture, wording of copy and type face, and differing 
from each other only in that one used a positive and the other 
a negative appeal, were included in the series. The table shows 
that the average intelligence group favored the positive appeal 
overwhelmingly ; that the high group favored it a good deal; 
and that the low group ranked it the same as the negative 
appeal. 

As previously noted, it has been impossible to determine the 
statistical reliability of the figures given here. Further studies 
of this nature will undoubtedly be necessary to check the ac- 
curacy of these results, and to determine whether they are true 
of intelligence groups generally, or simply of the individuals 
who took part in this study. 

A valuable refinement of the method described here would 
be the adoption of standardized advertisements for testing, in 
which all the variables except the one under examination at a 
particular time could be kept constant. If we had available 
such standardized advertisements, we would not have to 
assume, for instance, that we were obtaining a reaction to the 
particular factor of color, and not to some unforeseen, extra- 
neous factor entering into the reaction in question; we would 
know. 

Information concerning the preferences of the different intel- 
ligence (or, perhaps, socio-economic) groups of the population 
with respect to various features of advertisements would be of 
great value. Features that appeal to the more intelligent 
groups could be included in the advertisements of a product 
addressed to those groups, in the more intellectual, higher 
type periodicals and papers. In the same fashion, features that 
meet the preferences of the less intelligent could be included in 
those advertisements of a product designed to reach them, in 
the less intellectual, lower type periodicals and newspapers. 
In this manner, a definite step toward the immensely desirable 
economy of effort in advertising would be taken. 




















AN ANALYSIS OF CAPACITIES FOR PER- 
FORMANCE OF MENTAL DEFECTIVES 
SKILLED IN LACE-MAKING 


II. PERFORMANCE PATTERN IN SELECTED 
NON-STANDARDIZED TASKS* 


THEODORA M. ABEL, Px.D. 
Director of Research Trade Extension Classes, New York City 


AND 


ROY HAMLIN, M.A. 
Clinical Psychologist, Letchworth Village, Thiells, New York 


HIS study is the second of a series which is being carried 
by out at Letchworth Village, a New York State institution 
for mental defectives. The studies consist of an inves- 
tigation of the abilities and characteristics of small groups of 
successful and unsuccessful pillow-lacemakers. All of the sub- 
jects are middle grade mental defectives with I.Q.’s of 56 or 
less. 

In the previously reported study (7) the lacemakers (eleven 
subjects) were compared with the failures at lacemaking (seven 
subjects) on the Stanford-Binet and fourteen non-language and 
performance tests. No reliable difference between the two 
groups was found on any of these tests, and it was concluded 


* Paper read at the Eighth Annual Meeting of the Association of Con- 
sulting Psychologists, May 8, 1937. 

1 Acknowledgments are made to Dr. Elaine F. Kinder and to Miss 
Georgiana C. Taft, authors of the first article of this series, who also con- 
tributed to the present study; to Mrs, Arturo Menzel, Director of the 
Girls’ Industrial Department at Letchworth Village, who assisted through- 
out; to Dr. George M. Richards, for careful eye examinations of all sub- 
jects; to Dr. John C. Flanagan, of the Co-Operative Test Service, for com- 
ments and criticism of the statistical treatment; and to Dr. Margaret B. 
Erb and Miss Elizabeth Lane, of Letchworth Village, who administered 
many of the tasks used in the study. 


175 














176 THEODORA M. ABEL AND ROY HAMLIN 


that the making of pillow-lace is not apparently related to 
ability as measured by the more commonly used standardized 
tests. 

In the present, second study, non-standardized tasks were 
used. There were five series of such tasks in all. Two of the 
five series, Braiding and Mirror Drawing, were preliminary 
to the later work; and though they themselves did not distin- 
guish reliably between the two groups of subjects, they sug- 
gested a difference which was later confirmed by performance 
on the other three series of tasks. 

The Braiding was an exploratory series given to the success- 
ful lacemakers only. It was not given to the unsuccessful lace- 
makers since it involved lacemaking experience. The series 
required the subject to do one task, shift to a new but similar 
task, and then return to the initial task. The initial task was 
braiding with four bobbins, a process very familiar to the lace- 
makers; the new task was an unfamiliar variation, braiding 
with three bobbins. Upon return to the familiar task after 
working at the new task, the lacemakers showed an increase 
in speed and a decrease in accuracy.? Their performance sug- 
gested to the observers a marked release from tension upon 
return to the familiar task. We felt that this release from 
tension might be significant and therefore devised the second 
series of tasks upon which the lacemakers could be compared 
with the failures. 

Like the Braiding, the second series, Mirror Drawing, in- 
volved an initial, or basic task, a shift to a new task, and a return 
to the basic task. In the basic task, the subjects were required 
merely to draw horizontal pencil marks across vertical marks. 
In the new, or interference task, the subjects did the same thing 
by mirror drawing. 

As with the Braiding the results on the mirror drawing series 
were merely suggestive, not conclusive in themselves. But they 
influenced the planning of the other tasks used. 


2 The average gain in speed score was 18.1, A.D. 8.7. The average loss 
in accuracy score was .14, A.D. .10. 
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An analysis of the Mirror Drawing scores suggests the ‘‘per- 
formance pattern’’ which was used in studying the tests given 
subsequently. By a performance pattern we mean a relation- 
ship between two or more tests rather than the scores or aver- 
age of scores on one test or group of tests.* In the present 
instance, the performance pattern used throughout involved 
subtracting scores on ‘‘familiar’’* tasks from scores on ‘‘new’”’ 

The ‘‘familiar’’ task in the Mirror Drawing series was the 
final return to crossing lines without a mirror. The subjects 
had worked at this task at the beginning of the series, and for 
this reason the final return to the task may be called a return 
to a ‘‘familiar’’ task. The new tasks were the first trials at 
making marks without a mirror and the first trials at making 
marks with a mirror. 

Each lacemaker was given scores in terms of the number of 
failures surpassing her on each of the significant trials. For 
example, suppose four failures were better than lacemaker {1 on 
trial 1 (first trial without mirror). Six were better on trial 2 
(first trial with mirror). The average of these two scores, five, 
would then be the score for this lacemaker on new tasks. But 
only three failures were better than lacemaker $1 on trial 6 
(the final return to the basic task). The difference between 
the scores five and three, or two, thus represents the gain of 
lacemaker {1 on the familiar as compared with the new tasks. 
It should be noted that the lacemakers were compared with the 
failures only ; and, conversely. the failures were compared with 
the lacemakers only. 

When scored in this way, nine of the ten lacemakers, as 
compared with the failures, did better on the final return to the 

8 Dr. Charles A. Drake, of the Eagle Pencil Company, New York City, 
has used the term ‘‘ratio’’ to apply to a relationship similar to that which 
we call a pattern. (1) For use of the term pattern cf. (2), (3), (5), 
6), (8). 

4 term ‘‘familiar’’ is used merely for convenience. It is not ap- 


parent from the present study that familiarity and unfamiliarity are the 
essential qualities differentiating the tasks referred to by these terms. 
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basic task than on the two new tasks. The tenth lacemaker did 
equally well on both new and familiar tasks. Six of the seven 
failures, when compared with the lacemakers, did worse on the 
familiar task than on the new tasks. This may be expressed: 


Mirror Drawing 
Change from New to Familiar Tasks 
(Number of Opposite Group Surpassing) 








LACEMAKERS FAILURES 
TO teins 9 1 
No change ............. 1 0 
ee Oe eee 0 6 








There is a suggestion here that the lacemakers do relatively 
better on return to the basic or familiar task than on the two 
new tasks; and that the opposite is true of the failures. A\l- 
though no treatment of the scores or ranks indicated a ‘‘reli- 
able’’ difference, the suggestion seemed worth following up. 


Method and Procedure 


A description of the three remaining tasks, which show a 
definite difference between the two groups of subjects, follows: 

1. Marking. In this series, the subject’s basic task was to 
make marks with pencil in successive squares of graph paper 
according to the pattern: one horizontal mark, one vertical 
mark, one horizontal mark, ete. The two interference tasks 
were intended to be enough like and enough different from this 
basic task to cause the subject some trouble. The first inter- 
ference task consisted of marking according to a new pattern: 
one vertical, and then two horizontal marks. The second inter- 
ference task followed a still different pattern: one vertical 
mark, one horizontal mark, and then a blank space. The 
time scheme for the tasks was: 





en i er eS 2 minutes 
Se ea he eS 1 minute 
0 A RE BS od 2 minutes 


1st Interference .... 30 seconds 





— 


. 
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eee ne ae 2 minutes 
2nd Interference ..... 30 seconds 
ee 30 seconds 


In the Marking series the subjects repeated the basic task 
for two minutes one week later. 

Scores for this series were the number of items completed, 
less three times the number of errors. 

2. Card Sorting. In the initial and final tasks, the sub- 
jects sorted cards according to form. In the interference tasks, 
they sorted according to combinations of color and form. The 
time scheme was essentially the same as for the Marking series: 
the basic task required between one and three minutes; the 
interference tasks required less time. 

In the Card Sorting, as in the Marking, the subjects re- 
peated one trial of the basic task one week later. 

Scores were time for each trial; or, for the short trials, num- 
ber of items completed in thirty seconds. 

3. Tapping. The initial and final tasks consisted of tapping 
with a stylus back and forth between two holes on a tapping 
board. The interference tasks required tapping in four or five 
holes in different patterns. The time for each task followed 
the same scheme as in the Marking series. Scores were in 
terms of number of items completed, less three times the num- 
ber of errors. 


Results 
All of the last three series of tasks indicate the same difference 
between the successful and unsuccessful lacemakers as was sug- 
gested by performance in Mirror Drawing. 
The data on these tasks were treated in three ways: (1) in 
terms of the number of the opposite group surpassing each 
subject ;> (2) in terms of rank, and (3) in terms of raw scores. 


I. Number of Opposites Surpassing 


In terms of opposites surpassing, the Marking series shows 
the greatest difference between the two groups of subjects: 
5 Cf., p. 4. 





LT it IR get 


RS SS CS 











180 THEODORA M. ABEL AND ROY HAMLIN 


Marking 
Change from New to Familiar Tasks 
(Number of Opposite Group Surpassing) 








| LACEMAKERS | FAILURES 
rs 9 0 
No change ............. 2 0 
Pe ee siciwniiapiee 0 6 





The Card Sorting series does not show the difference quite 








so clearly : 
Card Sorting 
Change from New to Familiar Tasks 
(Number of Opposite Group Surpassing) 
| LACEMAKERS FAILURES 
RIES iinnpiccagbeceed 7 0 
No change ............ 1 1 
SS ae See 3 5 








The Tapping series shows about the same degree of difference 
as the Card Sorting: 
Tapping 
Change from New to Familiar Tasks 
(Number of Opposite Group Surpassing) 











| LACEMAKERS FAILURES 
i Re 7 | 2 
No change ............._ | 3 | 0 
Loss _....... * 1 | 4 
Il. Rank 


Use of scores in terms of rank order clearly differentiates 
between the two groups ef subjects when tasks from the three 
series are taken together. We took the results of Marking, 
Card Sorting, and Tapping and averaged all pertinent tasks; 
that is, we found the average rank on eight unfamiliar tasks 
and the average rank on five returns to basic tasks: We then 
substracted the latter average from the former with the follow- 
ing result: 
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Pattern Scores on Tasks 





AVERAGE 8 AVREAGE 5 RETURN P 
UNFAMILIAR TASKS TO BASIC TASKS P. 





11.2 10.9 0.3 7.5 
9.6 8.3 13 4.0 
13.5 12.4 11 5.0 
14.9 10.9 4.0 2.0 
3.9 3.9 0.0 9.0 
14.1 14.2 -0.1 10.0 
12.7 13.5 -0.8 12.0 
8.7 8.4 0.3 7.5 
13.5 8.8 4.7 1.0 
5.1 2.8 2.3 3.0 
8.2 7.6 06 | 6.0 








6.8 10.5 -3.7 16.0 
8.9 10.9 — 2.0 15.0 
6.5 11.8 -5.3 17.0 
4.4 5.4 -1.0 13.0 
4.8 5.1 -03 | 110 
6.4 7.7 -1.3 14.0 














Numbers in the left-hand column represent the eleven lacemakers; let- 
ters the six failures. 

The pattern score (P) is derived by subtracting the average rank on five 
returns to basic tasks from the average rank on eight unfamiliar tasks. 
The P. Rank is merely the rank order in pattern score. 


It can be seen that there is almost no overlapping between 
the successful and unsuccessful lacemakers. Ten of the eleven 
successful lacemakers surpass all of the failures in performance 
pattern score (P). And the eleventh lacemaker is surpassed 
by only one failure, their scores differing by five tenths of a 
point. The two groups of subjects are sharply differentiated. 


III. Raw Scores: Marking 


Because of the many statistical objections to the use of ranks, 
the raw scores were studied to see if they would bring out the 
difference between the two groups of subjects as definitely as 
did the ranks. The Marking scores taken by themselves bring 
out the difference better than do the averages of all scores: 
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Marking: Pattern Scores Based on Raw Scores 














TASK M.2 | TasK M.4 TOTAL TASK M.5 Px 
» per. 15 26 41 25 16 
® as 12 17 29 18 11 
SD tn 22 23 45 13 32 
4 = 0 0 0 7 - 7 
peer 35 50 85 39 46 
pee 4 5 9 0 9 
ee 32 34 66 19 47 
eal 43 41 84 40 44 
_ great 5 2 7 22 -15 
; eee 44 35 79 39 40 
BD 31 35 66 31 35 
Av. 23.5 8.D. 6.3 
TE scacie 31 35 66 8 58 
Oe cthun 34 47 81 27 54 
ae cece 35 35 70 30 40 
ae ice 38 47 85 36 49 
OP sess 36 41 77 35 42 
ii asbis 32 37 69 29 40 
Av. 47.2 8.D. 2.9 
23.5 
Diff. 23.7 8.D. 6.9 




















Numbers in the left-hand column represent the eleven lacemakers; let- 
ters the six failures. 

Tasks M.2 and M.4 are new, interference tasks. The total is the total 
score on these two tasks. Task M.5 is the final return to the familiar or 
basic task. The pattern score (Px) is derived by subtracting the score on 
task M.5 from the sum of the scores on tasks M.2 and M.4. 


The average pattern score, based on the raw scores of the 
Marking series only is 47.2 (S.D. 2.9) for the failures; and 
23.5 (S.D. 6.3) for the successful lacemakers. The difference 
between these averages is 23.7 (S.D. 6.9); this difference is 
3.43 times its 8.D.). The difference between the two groups is 
statistically reliable; but, of course, the number of subjects is 
small. 
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IV. Control Group 

The usefulness of a performance pattern in measuring a 
specific ability seems to us the most important indication of this 
study. The original purpose, however, was to find a difference 
or differences between the successful and unsuccessful lacemak- 
ers. We have found such a difference; but we may well ask 
ourselves whether the difference may not be due merely to the 
fact that the lacemakers have been making lace for from two 
to nine years, while the failures never really learned to make 
lace and have not been doing anything comparable to lace- 
making for some time. 

We have considered this possibility, and have attempted to 
throw some light on the question by using a control group. 
The control group consisted of eleven subjects, who had never 
made lace and who had never tried and failed to make lace, 
matched on mental and chronological ages with the lacemakers 
and failures. This control group was given the series of Mark- 
ing tasks exactly as they had been given to the other two groups. 

Now if the lacemakers gained over the failures on the return 
to a familiar task for the reason that they had been making lace 
for a period of from two to nine years, then the lacemakers 
should show just as much gain over the control group, and the 
control group when compared with the failures should show 
no marked difference. On the other hand, if the difference 
found between the lacemakers and failures is due to something 
else, then part of the control group should gain and part should 
lose. This is exactly what happens. When lacemakers, failures 
and control group are all taken together, put in rank order, 
and compared for gain from interference to return to familiar 
tasks, most of the lacemakers gain (eight out of eleven) ; half of 
the control group gain, and half lose (six as against five) ; while 
all of the failures lose, six out of six. (See table next page.) 

This result at least suggests that the difference found between 
lacemakers and failures is a difference that existed before the 
lacemakers took up lacemaking, and a difference, therefore, 
which may partially account for success or failure in lace- 
making. 
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Marking—Rank Change 
(New to Familiar Tasks) 


























LACEMAKERS CONTROLS FAILURES 
ee ie SN Eg 8 6 0 
No change 0 0 0 
GS Nigided 3 5 6 
Discussion 


Performance patterns, such as the one used in this study 
and more complicated ones, may prove very useful in measuring 
specific abilities. In this study, lacemaking ability is ‘‘mea- 
sured.’’ Drake (1) measured accident proneness; Jastak (3) 
suggests measuring psychotic tendencies (‘‘behavioral dysfunc- 
tioning’’) ; Glanville (2) delinquency ; ete. 

It is as a measuring device that we are stressing the possible 
importance of patterns. We do not feel that it is the province 
of the present study to consider the ‘‘theoretical significance’”’ 
of such patterns. 


Summary 


1. In this and a previous study, eleven successful lacemakers 
were compared with seven unsuccessful lacemakers. All sub- 
jects were middle grade mental defectives with 1.Q.’s of fifty- 
six or less. 

2. The previous study showed no difference between the two 
groups on more commonly used standardized tests. 

3. The present study, using five series of non-standardized 
tasks, definitely differentiates between the two groups, which, 
however, are small. 

4. The difference between the two groups was brought out 
not by scores or averages of scores on any task or group of 
tasks, but by a ‘‘performance pattern.’’ As used here, per- 
formance pattern refers to the relationship between scores on 
different tasks. In this case a comparison of scores on new 
tasks with scores on tasks somewhat familiar to the subjects, 
brought out the difference between the two groups. 
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5. The lacemakers did relatively better on return to a 


familiar task than on new tasks. The opposite was true of the 
failures. 


6. Performance of a control group on one of the five series of 
tasks indicates that the difference between the successful and 
unsuccessful lacemarkers is not due to the fact that the lacemak- 
ers have been making lace for from two to nine years, while the 
failures have not. The difference seems to be something more 
fundamental. 


7. The authors stress the possible general usefulness of per- 
formance patterns (relation of scores rather than scores them- 
selves) in measuring specific abilities. 
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THE PERFORMANCE OF NORMAL CHILDREN 
ON THE RANDALL’S ISLAND PER- 
FORMANCE SERIES 


8. W. BIJOU 
Delaware State Hospital, Farnhurst, Delaware 


HE Randall’s Island Performance Series’ is a pre-school 
scale designed to supplement and corroborate ratings and 
analyses from the Binet type of intelligence tests. It is 

a non-verbal test suitable for children and grossly retarded 
adults having a language handicap, a speech defect or an audi- 
tory impairment. The Series is so constructed that its upper 
limit forms a continuum with the lower end of the Pintner- 
Paterson Performance Scale. 

The individual items of the Series were selected from per- 
formance material reported by Baldwin and Stecher, the Yale 
Laboratory, Pintner and Paterson, Rachel Stutsman, and the 
Merrill-Palmer studies, and were standardized on retarded sub- 
jects, mentally two, three and four years of age according to 
the Kuhlmann-Binet Intelligence Test. The pertinent statis- 
tical facts concerning the chronological age and intelligence 
of the standardization group as obtained by L. E. Poull are 
presented in the upper section of Table I. It is to be noted 
first, that the highest chronological age is 14 years 11 months, 
and second, that the median Kuhlmann-Binet (K-B) IQ is 
41.75. Randall’s Island Performance (R. I.) IQ’s correlated 
with Kuhlmann-Binet IQ’s to the extent of + .89, + .02. 

In the standardization, the year 15 was selected as the upper 
chronological age limit in order to avoid the possibility of 
allowing undue performance advantage to subjects with supe- 
rior muscular development. To ascertain whether the degree 
of muscular maturation is an important variable within the 


1‘*The Randell’s Island Performance Series,’’ L. E. Poull, 1931, Colum- 
bia University Press, New York. 
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mental age range of the scale, and to check the adequacy of 
the standardization sample, Marion E. Doscher? administered 
the Kuhlmann-Binet (or in a few instances, the Stanford- 
Binet) and the Randall’s Island Performance Series to 200 
retarded subjects whose chronological ages ranged from 3 
years 2 months to 46 years, with a median of 8 years 1.2 months, 
and a quartile deviation of 2 years 10.2 months. These figures, 
together with those pertaining to the IQ’s of the group are in 
the lower section of Table I. Although Miss Doscher’s inves- 
tigation included over two and a half times as many cases as 
the Poull study, and although the chronological age range of 
her group included adults, the Kuhlmann-Binet IQ medians 
are within three points of each other. 

Miss Doscher arrived at a correlation of + .90, + .009, be- 
tween the Kuhlmann-Binet and Randall’s Island IQ’s, which 
is practically identical to the correlation found in the stand- 
ardization study. On the basis of this finding, she concludes 
that ‘‘the results indicate . . . that the prognosis from the 
original 77 cases does hold true.’’ 

It is evident that the results of these two investigations jus- 
tify grading retarded individuals according to Randall’s 
Island ratings. The question now arises: will the scale also be 
efficient for classifying normal children of pre-school age, 
despite the fact that it was standardized on a feebleminded 
group ? 

To determine this, 162 normal children were tested with both 
the Kuhlmann-Binet and the Randall’s Island Performance 
Series. The group consisted of 84 girls and 78 boys, 4 of whom 
were colored. One hundred forty-five were cases referred to 
the Catholic Charities Guidance Institute and were made avail- 
able through the courtesy of the Clinic’s Psychologist, Miss 
Margaret H. Halleran. At the time of the examination these 
children were living in private homes as dependent foster chil- 


2‘*The Correlation Between the Randall’s Island Performance Series 
and the Kuhlmann-Binet,’’ Marion E. Doscher, JourNAL or APPLiep Psy- 
CHOLOGY, Vol. 19, No. 4, Aug., 1935. 
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dren or as boarding-out charges. The economic status of the 
families with whom they lived varied, but each was at least self- 
sustaining. All the parents spoke English, although in some 
cases another language was also spoken. The other seventeen 
were children attending the nursery school of the Family Wel- 
fare Society of Queens, while their mothers were away at work. 
These children came from families with a marginal economic 
status. Their language situation at home was about the same 
as those from the Guidance Institute. 

To eliminate the influence of extraneous test factors, all chil- 
dren having a manual handicap or a marked visual or auditory 
defect were excluded. Those with a Kuhlmann-Binet IQ below 
76 were omitted in order to satisfy the criterion of an intellec- 
tually normal group. Since the Randall’s Island Performance 
Series was constructed to measure intelligence mainly at the 
two, three, and four year levels, children with a Performance 
Series mental age below 2 and above 4 years 11 months were 
also eliminated. 

Statistical summaries and measures of deviations of the 
group’s chronological age and test ratings are presented in 
Table II. The Kuhlmann-Binet IQ’s were found to correlate 
+.79, + 0.2 with the Randall’s Island IQ’s. 


TABLE II 


Summary of the Chronological Age, Mental Age, and IQ’s of 
the 162 Normal Children 





AGE 


K-B 
MENTAL 
AGE 


R. I. 
MENTAL 
AGE 








Range ........... 


1-11 
to 
5-9 


1-10.8 
to 
5-6 


2-0 
to 
4-11 





Median ...... 


3-8 


3-7.5 


3-7.5 


132 
101.12 





ae eee 





8.5 





8.5 





8.0 





8.1 








This correlation of + .79 is high considering that performance 
seales usually correlate with the Binet type tests somewhere 
between + .45 and +.65. Simple item analysis and comparisons 
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of the two, three, and four year levels of the Kuhlmann-Binet 
reveal why this occurs. If we identify a performance test as 
one which requires the subject to do rather than to say some- 
thing, then the two year level of the Kuhlmann is entirely per- 
formance. By the same criterion the three year level is 25 
per cent performance and the four year level is 12.5 per cent 
performance. Thus we understand why the correlation of IQ’s 
for the separate year groups decreases as we go up the age 
seale, as follows: + .87 for the two year group, +.84 for the 
three year group, and +.80 for the four year group. Beside 
the fact that the two, three and four year levels of the Kuhl- 
mann taken as a whole are 38 per cent performance in nature, 
it should be pointed out that there are three identical items in 
the scales correlated. These factors account for the unusually 
high correlation found in this study. 

On the other hand, this correlation is lower than those found 
in previous studies with these scales. This discrepancy, we 
believe, is attributable to the inherent differences in the subjects 
employed. That feebleminded subjects with mental ages be- 
tween two and four are not behaviorly the same as normal 
children with similar mental ages, is generally accepted. Psy- 
chometrically, these subjects reveal different inter-test rela- 
tionships. Studies have repeatedly shown that defective 
subjects, given both a performance and a verbal scale, tend to 
make higher ratings on the former. On the other hand, when 
both types of scales are administered to normal children of pre- 
school age, the chances are approximately even that the scores 
may be higher on either the performance or verbal test. For 
example, in Miss Doscher’s feebleminded group of 200, 62.5 
per cent made higher Randall’s Island IQ’s than Kuhlmann- 
Binet IQ’s, 28.5 per cent made higher Kuhlmann-Binet IQ’s 
than Randall’s Island IQ’s, and 9 per cent made identical 
seores. In contrast to this, 39.5 per cent of the group used here 
made higher Randall’s Island IQ’s than Kuhlmann-Binet IQ’s, 
43.2 per cent made higher Kuhlmann-Binet IQ’s, and 17.3 per 
cent made even scores. This tendency of feebleminded subjects 
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to make different psychometric patterns from those of normals, 
may account for the difference in correlation between the present 
study and previous ones. 

The two former investigations with these scales have shown 
the justification of grading retarded individuals according to 
Randall’s Island Performance ratings. The results of the 
present investigation indicate (a) that the use of Kuhimann- 
Binet scores as a basis for standardization is a valid procedure 
in this instance, because of the Scale’s high performance con- 
tent, (b) that standardization of the Series on a feebleminded 
group does not limit its valid use to defective subjects only, and 
(ce) that the Randall’s Island Performance Series is an accurate, 
effective, and convenient instrument for the classification of 
normal children of pre-school age. 











THE RELATIVE SIGNIFICANCE OF TIME AS A 
FACTOR IN TESTS OF ABILITY AT THE 
COLLEGE LEVEL* 


ANNA LOIS SAUM 
New York City 


INTRODUCTION 


HILE much is being done constantly to improve college 

\X / ability tests with a view to increasing their reliability 

for predictive purposes, very little literature is avail- 

able on the significance of time as an element in the test. Up to 

the present, however, the element of time apparently has been 

assumed to be significant for practically every intelligence test 

of college level (the field to which this discussion is limited) is 
given under time-limit conditions. 

A recent studyt indicates that a slightly better prediction of 
scholastic achievement may be obtained from an ability test con- 
ducted under ‘‘work-limit’’ conditions than one conducted 
under the usual ‘‘time-limit’’ conditions. 

The following questions then arise: 

1. Is the increased predictability due to the additional time 
granted, or is it due to the removal of the pressure of 
time? 

Is time itself a significant factor, or is it negligible? 
3. Is there an optimum time for college level intelligence 
tests? If so, is it based on the actual influence of time 


* This investigation was made at Ohio University under the direction of 
Dr. James P. Porter and was submitted to Ohio State University as a 
thesis for the Master’s degree. Copies of this thesis are on file in the 
Library at Ohio State University. 

+t Workman, B. E. The Work-limit Method versus Time-limit Method 
in the Construction and Administration of College Ability Tests. Ohio 
College Association Bulletin, No. 79. 


no 
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in the test, or is it to be determined by physical and 
mechanical factors? 
It was found necessary to limit the present discussion to ques- 
tion 2: Is time a significant factor in college level intelligence 
tests ? 


OTHER STUDIES 


Thorndike’ in 1915 concluded from a study of tests in arith- 
metic that the pupils who worked most rapidly were also the 
most accurate. This direct positive relationship between speed 
and accuracy was long accepted without much critical experi- 
mental investigation. More recent studies adapted to more 
diverse subject matter have somewhat weakened the foundation 
for the assumption that speed and accuracy are closely and 
positively related. 

Myers? reports an experiment conducted in the same year in 
which subjects were submitted to two tests—one a time-limited 
condition, and the other relatively unlimited. He concludes 
that learning against time increases the efficiency of the learner, 
and suggests further that the time pressure acts as a definite 
stimulus for concentrated effective effort. As an illustration 
of this point Myers calls attention to the procrastinating stu- 
dent who does a surprising amount of work at the last minute. 
He has, according to Myers, only waited until the pressure of 
time provides him with sufficiently strong motivation to induce 
his best effort. Myers’ results are not directly comparable with 
our own, as he does not enter into the relative changes in stand- 
ing among the subjects in the two types of performance. 

In 1918 King and McCrory* analyzed the results of a battery 
of freshmen tests given at the State University of Iowa. They 
found the correlations between speed and scores on the different 


1 Thorndike, E. L. The Relation between Speed and Accuracy in Ad- 
dition. Journal of Educational Psychology, V, p. 337. 

2 Myers, G.C. Learning against Time. Journal of Educational em 
chology, VI, pp. 115-116. 

8 King, Irving, and McCrory, James. Freshman Tests of the State 
University of Iowa. Journal of Educational Psychology, IX, pp. 32-47. 
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parts of the tests to be very low. The highest correlation be- 
tween speed and score is obtained on the Courtis Arithmetic 
Test (.41 for women, and .38 for men). The correlations on 
other tests (opposites, visual imagery, analogies, information, 
and logic memory) range from .03 to .07 for women and are 
consistently low negative for men. 

Mudge* found practically no relation between speed and 
accuracy, and Ruch,° working with the Army Alpha, found no 
interchange of position between low and high scoring subjects 
with change in time conditions. He found that increased time 
did not permit low scoring subjects to overtake the high scoring 
subjects. 

Longstaff and Porter® in a study of objective tests in general 
psychology found very little relationship between speed and 
accuracy factors. 

While such studies show some inconsistencies, in general they 
seem to indicate little or no relationship between speed and test 
scores. The field is relatively barren of objective studies and 
seems to present an abundance of problems to be solved and 
questions to be answered. Educators who are always ready to 
predict the quality of a student’s work by the speed with which 
he works are finding that they must be a bit cautious about their 
predictions until further investigation has shown just how much 
weight shall be attached to the factor of speed or time. 


CRITERIA USED IN THE STUDY 


Subjects for this study were obtained from classes in gen- 
eral psychology during the academic year 1929-30. They 
were students who had taken, upon entrance to Ohio University 
in the fall, the Ohio State Psychological Test, Form 14, under 

4Mudge, E. L. Time and Accuracy as Related to Mental Tests. 
Journal of Educational Psychology, XII, pp. 159-161. 

5 Ruch, G. M. Power vs. Speed in Army Alpha. Journal of Educa- 
tional Psychology, XIV, pp. 193-209. 

6 Longstaff, H. P., and Porter, J. P. Speed and Accuracy as Factors 
in Objective Tests in General Psychology. Journal of Applied Psychol- 
ogy, XII, pp. 636-642. 
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the prescribed time-limit conditions, ninety-three minutes for 
the test. 

The experimental group, 193 students, is considered a fair 
sampling of the student body scholastically, the mean scholar- 
ship for one semester being 1.21 points. The University average 
scholarship is 1.00 point. 

Ohio State University Psychological Test, Forms 13, 15, and 
16 were administered to this group during the first semester 
under ‘‘work-limit’’ conditions. That is, the students were 
given the test booklets and told to work as quickly as possible, 
put forth their best effort, and work until they finished the test. 
The time of the beginning of the test was marked on the booklet, 
and the time again taken when the student turned the test in to 
the examiner. In this way the time used in taking the test was 
obtained for each individual subject. 

The subject’s score, number of errors and number of omis- 
sions on both work-limit test and time-limit test were obtained, 
as well as the time used on the work-limit test and number of 
attempts made on the time-limit test. On the work-limit test 
it is assumed that the student attempts every item. Hence the 
number of attempts on the work-limit test is 395, constant in 
every case. The foregoing factors, together with point-hour 
ratio for one year and for one semester, and three speed-ac- 
curacy indices, constitute the thirteen variables used for statis- 
tical study. Table I provides a key to these variables, together 
with their means. 

The speed-accuracy indices are computed by dividing the 
time spent on the test by the number of right responses (com- 
puted for both tests), and by dividing the time spent on the 
time-limit test by the number of attempts. (Z na a): In 
the first two cases the indices do not indicate the absolute time 
spent on each right response, but rather the time per right -re- 
sponse distributing the entire time used only over those state- 
ments which were correctly answered. This gives comparable 
measures. 
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All correlations were computed by the calculating machine 


TABLE I 
Thirteen Variables and Means* 





























VARIABLE MEAN 
X, Score on Time-Limit Test 193.9 
X, Time Spent for Each Right Response on Time-Limit Test 

ee; ODO WUT TR init ecneectensetntces eects citeeestchnere 244.6 
X, Number of Errors on Work-Limit Test 175.26 
X,; Number of Omissions on Work-Limit Test 00000000. 76.99 
X, Time (in minutes) Used in Taking Work-Limit Test ........... 175.8 
X, Time Spent for Each Right Response on Work-Limit Test _........... 
X, Point-Hour Ratio for One Semester 

X, Point-Hour Ratio for One Year 1.21 
Xx Number of Errors on Time-Limit Test 0..0.0.0..000..0.cccccsccccceennmen 130.16 
X,;, Number of Omissions on Time-Limit Test 2.000000... 49.47 
X,, Number of Attempts on Time-Limit Test 323.78 
Xis 


Time Spent for Each Attempt on Time-Limit Test 





* All correlations computed are not included in the present study. The 


data were obtained with a view to expediting related studies to be carried 
on during the current year. 


method described by Toops,’ the summation X, summation X?°, 
and summation XY values being computed on the Hollerith 
tabulating machine, with no correction made for grouping. 
However, intervals used in transmuting the scores were rela- 
tively small. 

Correlations were first computed for each form of the work- 
limit test (Forms 13, 15, and 16). These correlations were 
found to be sufficiently high to warrant combining all three tests 
in one group. 


INTERPRETATION OF DATA 


The subjects were studied in five groups as shown by Table IT. 
Hereafter the groups will be referred to by number. Groups 2 
and 4 include groups 1 and 3 respectively, with the addition of 


7 Toops, Herbert A. Computing Intercorrelations of Tests on the Add- 
ing Machine. JourNAL or APPLIED PsycHo.oey, VI, pp. 172-184, 
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a few subjects who were in our experimental group but did not 
complete the entire year’s work. Group 5 is merely the entire 
experimental group. 

Since the correlation oetween first semester and year point- 
hour ratio was found to be, for men .898, and for women .910, 
it was deemed sufficient to calculate r’s for only one combined 








TABLE II 
Groups Studied 
GROUP BASIS OF SELECTION NUMBER 

1 All men completing one year or more residence work 73 
2 All men completing one semester OF MOTE ~.....cccomm 83 
3 All women completing one year or more residence work 97 
4 All women completing one semester or more ...................... , ae 
5 All cases (men and women) completing one semester 

or more .. 








group. The group in which one semester’s work is taken as 
scholarship criterion (X,) was used to gain the advantage of 
the largest number of cases. 

The correlations between time-limit test and work-limit test 
are presented in Table ITT. 











TABLE III 
Zero Order Correlations between Scores on Work-Limit and Time-Limit 
Tests 
MEN WOMEN ALL 
GROUP 
1 2 3 + 5 
714 .752 .768 .773 .742 
Tis OOOO SOr eee cress seses sees seeeeneseeerrees ce .039* — .033 + .028 + .026 + .022 











* All Probable Errors of r in this and following tables have been ob- 
tained from Holzinger’s Statistical Tables for Students in Education and 
Psychology. 

The relatively high degree of correlation between the two 
tests would indicate that the test is not primarily a test, of 
speed, but rather one of ability. 

Students frequently remark that they could do much better 
if they were given more time on intelligence tests. An exami- 
nation of the mean scores on time-limit test and work-limit test 
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indicate that this is true, when absolute score is considered. 
But the correlation shown in Table III indicates that relatively 
speaking there is a high degree of relationship in the improve- 
ment of the subjects. Relative standings do not change very 
greatly. It is true that the student improved his raw score in 
the additional time, but other students have also improved in 
a comparable degree. 

It is reasonable to assume that the student with a poor score 
on the time-limit test has more opportunity to improve than 
the student with a high score. For the student with a high 
score has more nearly exhausted the possibilities afforded by the 
test. But added time does not enable the poor subject to over- 
take or even closely approach the higher scoring subjects. 

While the added time has no doubt increased the student’s 
raw score, an examination of the means, Table I, shows that the 
student has not appreciably affected the accuracy with which 
he works during the increased time. The increase of work- 
limit over time-limit in mean score is 51 items, while in errors 
the mean increases 45 items, and in omissions the increase is 
27 items. ; 

Table IV shows the correlation between scholarship and test 
scores, both time-limit and work-limit. Variable 8 is used as 
scholarship criterion for those groups completing a semester, 
and variable 9 is used as scholarship criterion for those groups 
completing a year. 

The increase in predictability of the work-limit test over the 
time-limit test on the final combined group of men and women 
used in this study is only slightly higher than the probable 
error of the coefficient of correlation. The greatest increase 
(.098) is in the group of men who completed one year or more 
of residence work (group 1). The consistency of the increase 
is noticeable. 

An interesting sex difference is consistently demonstrated in 
this table. In the case of the men, scholarship for one year 
correlates more highly with test score, either time or work, than 
does scholarship for one semester. Just the opposite condition 
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TABLE IV 
Zero Order Correlations between Scholarship and Scores 
MEN WOMEN ALL 
GROUP 
1 2 3 4 5 
Time Limit 
567 .635 .601 
Bigg, ccieescntsnactetcnterinpecsocenenitone + 051 “ 038 _ 031 
576 .600 
Tig sees ceeeseecerseecseressececeecesesesssess + .053 a 044 
Work Limit 
645 .671 .646 
Blew  pecwsciedetasceeppeseesesenerscceseciees + 044 + 035 + 028 
.674 .649 
Ts9 Sererceeescccescecesesceseceseccesecsesses + 044 + .039 





prevails for the women. The highest agreement is found be- 
tween scholarship and first semester marks. This may be due 
to several contributing factors. It may indicate that women 
adapt themselves more readily to college situations than do men, 
but evidently do not succeed in maintaining their original stand- 
ing. Again, social factors may contribute something to the 
situation. Perhaps the first semester offers more distraction for 
men than for women in the form of freshman duties and par- 
ticipation in sports. Both of these hypotheses are purely the 
subjective opinion of the author, but are offered at least as 
problems that might be investigated experimentally if this 
agreement is found to be consistent in other studies. Experi- 
mental data are not available to explain this feature. 

Table V is a summary of the correlations obtained between 
omissions on both time and work tests (r5),11)), and errors on 
both time and work tests (8,4) 10) )- 

The correlations in Table V indicate that there is consider- 
ably less agreement between the number of statements omitted 
than there is between the number of items incorrectly answered. 
The comparatively high correlation between errors indicates 
that there is but little change in the accuracy of the subjects 
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TABLE V 
Zero Order Correlations between Errors (Time-Limit and Work-Limit) 
and Zero Order Correlations between Omissions 
(Time-Limit and Work-Limit) 
1 2 3 4 5 


383 438 339 358 .270 
Tosa) +.068 +.060 +.060 +.056 +.045 














y 616 634 650 634 -669 
won +.048 +.046 +.039 +.039 +.026 








under the two testing procedures. Again, an examination of 
the means given in Table I shows that the increase in mean 
error is nearly equal to the.increase in number of correct 
responses, but the increase in omissions is considerably less. 
The ratios are 45:51, as against 27:51, tending to show that 
fewer omissions are made on the work-limit test. 

The definition of the term omissions is kept constant in both 
cases. In the case of the work-limit test, it is assumed that 
the student attempts all 395 items. The omissions are all 
statements in the test, then, that are not answered either cor- 
rectly or incorrectly. On the time-limit test, it is assumed 
that the student has sufficient time to attempt only those items 
including the last item marked. Omissions are all statements 
down to the stopping point which are not answered either cor- 
rectly or incorrectly. Those statements beyond where the 
student is forced to stop because of time are disregarded. In 
the work-limit test the number of items remains constant, while 
in the time-limit test the number of items varies with each 
subject but the time remains constant. If the time-limit omis- 
sions were assumed to be all items out of the entire 395 which 
are not answered, then the time-limit test would be considered 
as a work-limit. This would make our comparisons invalid. 

Table VI is composed of the correlations involving time used 
on work-limit test as one factor in the r. 

All correlations with time are found to be insignificant for 
predictive purposes, ranging from —.128 through .0@ to .114. 
The correlation between work-limit score and time (rgg) is less 
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than its own probable error. The correlation shows with a 
fair degree of conviction that there is practically no relation 
between time and test score. The very small amount indi- 
cated for the entire group, .046, tends to show that what agree- 
ment exists between time and score is positive. That is, the 
student who uses the most time tends to make a higher score, 
but it must be kept in mind that a correlation coefficient of 
.046 can show nothing more than direction. 




















TABLE VI 
Zero Order Correlations in Which Time is One Variable 
GROUP 1 2 3 4 5 
2 — .038 -.017 114 113 .046 
giants it + .080 + .074 + .067 + .063 + .047 
pe .086 .086 .085 
GD carcccccctecncensececess + .073 + .064 ca .047 
- -005 .077 
© wrvveeeesenesceeenceeres + .080 + .064 
m .001 015 — .128 — .095 — .027 
ee + .080 + .074 + .067 + .068 + .048 
. .003 — .002 — .034 — .056 — .035 
GI] woresenecnseccerccessoee + 080 + 074 + .067 aa 064 + .048 





There is a consistent sex difference displayed by rss, how- 
ever, in that in this study the correlations for men are (con- 
sistently) low negative and those for women are (consistently) 
low positive. This indicates that while the men who make 
higher scores tend to use less time, the women who make higher 
scores tend to use more time. This seems to verify the popular 
opinion that men who work well are inclined to be content 
with rapidly secured results, while women are inclined to 
accept their results more slowly. The author advances the 
hypothesis that the men who work rapidly turn in their papers 
as soon as they finish with more or less indifference as to their 
results. On the other hand, the women are more inclined to 
go back and check their results and turn in their papers rather 
reluctantly. They are probably a bit more eager to make a 
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good impression. This explanation must be regarded as purely 
parenthetically inserted in this discussion, for it represents the 
author’s subjective opinion. It is not stated as a fact. 

Correlations between scholarship and time (rgg and rgg) are 
also extremely low, but consistently positive. This positive 
relation indicates that if there is any tendency toward agree- 
ment, it lies in the fact that students who make better scho- 
lastic records are inclined to spend more time on the work- 
limit test. It is the author’s opinion that persistence is more 
necessary in obtaining high scholastic marks in college than 
is speed of work. The positive correlation seems to verify 
this assumption. 

The correlations between omissions and time (rs¢) and be- 
tween errors and time (rg) are in almost all cases lower than 
their probable errors, which renders them useless for purposes 
of prediction. The correlation between omissions and time 
offers a slight sex difference, but the correlations are so low 
as to indicate direction only. Women who spend more time on 
the test tend to omit fewer than those who require a shorter 
period which seems to verify one’s expectations. The correla- 
tions for the men do not indicate this, although the correlation 
for the entire group is also negative. 

Table VII is included to show the relationship existing 
between the speed-accuracy and time indices. 











TABLE VII 
Zero Order Correlations between Speed-Accuracy 
and Time Indices 
GROUP 1 2 3 4 5 
‘ 560 562 619 569 
GY vveneneeessenenreeresees + 054 + 051 + .039 + 031 
. -249 228 312 247 





Examination of the variables themselves shows that the time 
per right response was considerably greater in work-limit, 
although the correlations show rather close agreement in rela- 
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tive position. The correlations between time on work-limit 
test and time per attempt on time-limit test (1,6):13)) are also 
positively related, although not so highly. There is some 
relation, however, between the two measures of time. 

In order to measure statistically the influence of time as an 
element in the score and scholarship situation, three partial 
correlations and one multiple correlation are included in the 
data in Table VIII. The corresponding zero r’s are also 
included for purposes of comparison. 


TABLE VIII 


Correlations Indicating the Influence of the Time Factor 
(Group 5 only) 


Tas.6 .645 + .028 
Ts .646 + .028 
Ta) @00).6 .669 + .026 
T (4) (10) .669 + .026 
Tw)«1).6 -270 + .044 
T¢s)a1) -270 + .044 
Ra.es 649 + .028 
Tag .646 + .028 
































An examination of Table VIII shows that holding time 


constant does not affect, to three places, the correlation 
between errors (1r,4),10)) nor the correlation between omissions 
(T.s)<11)). This indicates that the correlation between omis- 
sions and the correlation between errors are due to some other 
contributing factor rather than the time used on the work- 
limit test. These correlations indicate that time has no influ- 
ence in a measurable amount. 

Partial and multiple correlations present a difficulty in sta- 
tistical method which dare not be overlooked. In computing 
a partial correlation it is assumed that the three or more vari- 
ables included in the correlation are pure measures. That 
is, for statistical purposes we assume that a partial correla- 
tion between score and scholarship in which time is held con- 
stant measures nothing but these three factors. This is not 
at all likely to be true. It is.the best statistical method we have 
for measuring the influence of any one variable, but its limita- 
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tions must be kept in mind. There are so many immeasurable 
factors that enter into the situation to complicate it that we 
cannot dogmatically state that a partial shows the definite influ- 
ence of certain factors. We must exercise some caution in 
such interpretation. 

The same limitation applies to multiple correlation. If we 
add one factor to a zero order correlation (¢.g., add time to 
correlation between scholarship and score), we may get a 
noticeable increase; if a second factor is added, a slightly 
higher increase may be obtained. But after several variables 
have been added to the correlation we find our increase grow- 
ing less and less until finally regardless of the number of 
factors added, we cannot raise the correlation above a certain 
point, which will undoubtedly be less than 1.00. Whereas, if 
all factors which go to make up the situation were known and 
measurable, if included in the correlation, we could expect 
a perfect correlation. Hence we must always make allowance 
for the unmeasured factors of a situation. 

The correlation between work-limit score and scholarship 
(rss) is decreased .001 by holding time constant. A decrease 
of this amount is utterly insignificant, and again shows that 
the time used on the work-limit test does not affect the pre- 
dictability between score and scholarship. By adding time to 
the correlation between score and scholarship (Rg), we in- 
crease the correlation only .003, verifying the conclusion from 
the partial r. 

Inspection of Table I shows that the mean time used on the 
work-limit test is almost twice that allowed for the time-limit. 
The standard time limit for the Ohio State University Psycho- 
logical Test used is 93 minutes, whereas the range on work- 
limit test is from 90 to 270 minutes. Only one student used 
as short a time as 90 minutes. The mean falls at about 176 
minutes. 

GENERAL INTERPRETATION OF RESULTS 


The statistical material presented in the foregoing pages is 
intended to show just how significant time may be considered 
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to be as a factor in college level intelligence tests. The results 
show that time in itself is not significant. That is, the actual 
number of minutes the student spends on the test does not 
influence directly his relative score, nor has it any direct rela- 
tion to his grades in college courses. It is to be admitted that 
the very slight agreement which does exist between time and 
scholarship is positive. College work, in the opinion of the 
author, demands perseverance more than speed. It seems prob- 
able that the student who is willing to work doggedly on may 
be expected to reach a higher scholastic achievement (as mea- 
sured by grades) than the student who applies himself to a 
task but for a short time. The slight positive agreement, 
although too slight to be significant in its predictability, tends 
to validate this belief in a small degree. The element of 
perseverance is an element which appears to be worth studying 
in this type of test. Our work-limit test may be in part a 
measure of perseverance and endurance, rather than one in 
which speed plays a part. 

Studies have repeatedly shown that students making higher 
scores on intelligence tests report less time spent on study 
than students who score low. A study now under way, how- 
ever, tends to show that a higher correlation may be obtained 
between test score and scholarship by adding a measure of in- 
dustry. Time is not a part of the industry measure used and 
for that reason the study may throw some light on other factors 
which enter into the time-test-scholarship relations. 

There is a growing tendency to call intelligence tests mental 
alertness tests, and to really use measures of alertness as mea- 
sures of intelligence. Time-limit tests might rightly fall into 
the alertness test category, whereas work-limit tests are tests 
of power, persistence, perseverance, and similar factors. We 
believe that a student’s scholastic achievement depends more 
upon the last-mentioned factors than upon the speed with 
which he works. The dogged persistence of the plodder is 
much more likely to result. in a high grade than the sketchy, 
hasty work of the student who passes over obstacles without 
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conquering them, or allows them to entirely stop his work. 
We are mindful of the fact that our correlation is so low as 
to indicate relatively little significance as to time, but prob- 
ably these are personality traits worth considering. 

Even though our correlations indicate that time is insig- 
nificant, the fact remains that a better correlation has been 
obtained between the Ohio State University Psychological Test 
and scholarship when the test is given under work-limit condi- 
tions. If we eliminate the time spent on the test as the con- 
tributing factor, what remains to account for the increase in 
predictability? That becomes another problem, but we take 
the liberty to suggest a few alternatives. 

In the first place, the directions for the two types of test 
are very different. In the time-limit test the student is ad- 
vised that he will have a certain number of minutes in which 
to complete the test. In the work-limit test he is told that he 
may work as long as he cares to. Each type of direction calls 
forth a different mental set. The first calls forth a set for 
speed ; the second promotes a composure and feeling of ease. 
In the second case the student may work at his own individual 
tempo and the thought of time-pressure is not present to dis- 
tract his attention. His energy may be concentrated wholly 
upon the task at hand, which is a test of his ability. 

This difficulty could be attacked by failing to indicate a time 
limit on the test. Do not include the time in the directions 
given the student, but let the student work unconscious of 
any time element. The examiner may then call for work to 
be ended at the desired time. This would eliminate the stu- 
dent’s set for speed. It is to be expected that raw scores on 
such procedure would be lower, as the student will probably 
work much more slowly when time-pressure is lacking, but 
change in relative standing cannot be predicted. 

Another factor which may enter into the situation is the 
different purposes for which the two tests were given, and the 
time at which they were given. The time-limit test (Form 14) 
was the test required of all entering students for admission to 
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the University. The students were faced with the situation of 
an ‘‘entrance test.’’ They were informed that the test was to 
become a definite part of their university record, and in many 
cases a disturbing fear resulted. Then too, the students had 
been on the campus only a few days at the time they took the 
test, and were confronted with an entirely new environment 
and strange situations. When they were given the work-limit 
test they were aware that the results would be used for experi- 
mental study only, and the element of fear of failure was not 
present. Then, too, orientation was slightly better, as the tests 
were given late in the semester. The usual difficulty in that 
many students are indifferent to their achievement on intelli- 
gence tests was no doubt present in both situations. 

Examination of the test booklets raises a question as to 
whether or not the time-limit situation was entirely eliminated 
in the work-limit test. The actual time when work on the test 
ceased is recorded. A surprisingly large number of subjects 
finished their work on an even hour, such as four o’clock, nine 
o’clock, ete., indicating that the subject actually set the time 
when he should stop work. Examination of variable 6 (Ap- 
pendix 1) shows that the time variable is a number divisible 
by 5 or 10 more frequently than not. It is the author’s opinion 
that chance does not satisfactorily explain this phenomenon. 

Another factor reported by the examiner seems to suggest 
some further indications of sex differences. Some subjects 
were still at work on the tests at dinner time in the evening. 
Very few men remained beyond that hour, while many women 
violated dormitory meal hours to continue their work. The 
men stopped and turned in their booklets, but the women con- 
tinued their work, checking back over that which they had done 
with no appearance of haste. 


OTHER PHASES OF THE STUDY 


If, as the study indicates, time is not itself a factor to deal 
with, how shall we determine the length of college level intelli- 
gence tests? It would seem that optimum time is to be based 
upon such factors as the convenience of the examiner, the 














208 ANNA LOIS SAUM 


academic routine into which the examination must be fitted, 
and physical factors, such as fatig.e, endurance, stamina of 
the group to be tested, and complementary elements. To get 
at the physical factors, a slightly different technique appears 
necessary. ‘Two suggestions are offered. 

Time-limit tests should be administered to a group of stu- 
dents under the usual conditions. At the end of the standard- 
ized time period the students should be given pencils with 
different colored lead, and told to continue their work for a 
given period, thirty minutes or more. Then the increment of 
the additional time might be objectively studied. 

Another method, intended more specifically to measure fa- 
tigue is suggested as follows. Administer a test under work- 
limit conditions with the following changes. At the end of 
each thirty minutes (or other convenient interval) the student 
should indicate by a mark on his paper the item on which he 
was working when the time interval was called. He should, of 
course, be required to work until he feels he has exhausted the 
test so far as his own ability permits. It would be desirable 
that the test used in this procedure be of the omnibus type 
so that the order of parts or items would not contribute diffi- 
culty to the results. 

Accomplishment in each interval could then be compared 
with every other interval. If there is an optimum time, these 
intervals should be helpful in indicating it. The onset of 
fatigue could thus be measured by finding the interval, if such 
exists, where work begins to lose its effectiveness. Doubtless 
individual differences in physical stamina, perseverance, and 
concentration will become apparent. This is a question which 
the author intends to investigate as a future study. 

Freeman® suggests that the time limit of tests which measure 
power is a question to be settled on the basis of convenience. 
With this we agree. We may justly conclude that the Ohio 
State University Psychological Test is one of power rather than 
speed. We have found the correlation between a work-limit 


8 Freeman, F.8. Power and Speed: Their Influence upon Intelligence 
Test Scores. JOURNAL OF APPLIED PsycHo.oey, XII, pp. 631-635. 
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test and a time-limit test, using the Ohio State University 
Psychological Test as criterion, to be relatively high, which 
indicates that it is not a speed test. Then may we suggest that 
the time-limit of 93 minutes which is standardized on the forms 
used in this study may not necessarily be the most convenient 
time. If time itself is no significant factor, further study 
of personality traits and emotional factors of the subjects as 
well as administrative policies of the Ohio colleges using the 
test seems justified in determining the time-limit to be placed 
on this test. It certainly suggests a problem. 

One fact has been brought out with increasing emphasis 
during the course of this investigation; namely, the oppor- 
tunity and need for experimental method and procedure in 
analyzing the various factors other than time which enter into 
the testing situation. Emotional and personality factors might 
be objectively studied with beneficial results. A variety of 
problems have presented themselves. Considerable data gath- 
ered during this study, but not used herein, will be helpful in 
carrying out further problems along this line of thought. Be- 
fore the question of optimum time can be answered, all the 
contributing factors of the situation must be submitted to 
experimental study. The question of optimum time is the ulti- 
mate aim of this and related studies. 


SUMMARY 


From time to time throughout the study certain facts have 
appeared to be significant outcomes. These results are here 
brought together in summary form. 

1. Time as correlated with certain measures of student 
achievement and various phases of test analysis appears to be 
so insignificant as to render it a negligible factor in college 
level intelligence tests. 

2. Lengthening the period of testing time does not improve 
the accuracy of college students on the Ohio State Psycholog- 
ical Test. 

3. The correlations indicate that there tends to be a slight 
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positive relation between length of time used in the test and 
score for women. 

4. The correlations indicate that there tends to be a slight 
inverse relation between length of time used in the test and 
score for men. 

5. The slight positive correlation found between time and 
scholarship indicates the possibility that persistence or endur- 
ance has some influence upon scholarship. 

6. The study as a whole suggests a definite need for further 
experimentation on the question of optimum time in college 
level intelligence tests. 
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BRIEF REPORTS OF MENTAL TESTING* 


A NOTE ON A CASE OF SPELLING DIFFICULTY 


ROSE G. ANDERSON 
Psychological Service Center of New York 


N recent years the theory of cerebral dominance has had 
considerable influence in accounting for speech and read- 
ing difficulties. The hasty characterization of children who 

show reversal tendencies in reading and spelling as cases of 
strephosymbolia provides an illustration of the operation of 
the ‘‘stimulus-error.’’ In their zeal to fit all types of reading 
and spelling difficulties into this category certain workers have 
concentrated on positive cases. When reversal errors have 
been found a diagnosis has been made on this basis without 
further study of causative factors and without analyzing all 
types of errors to study the relative frequency and significance 
of different types. 

The case of a fifteen-year-old stutterer with a spelling dis- 
ability is illustrative. According to his mother’s statement his 
spelling difficulty was due to his tendency to reverse letters. 
She had observed this and it had been reported to her by teach- 
ers. When she consulted a prominent speech specialist, mother 
was told that it would probably be necessary to change him 
from a right-handed to a left-handed boy. 

Our study of the case revealed a variety of contributing fac- 
tors and indicated other remedial procedures which might be 


* It is the hope of the editors that this new section of the JouRNAL oF 
APPLIED PsycHoLoey will afford a medium for prompt publication of 
notes and brief reports of interest in the field of mental testing, diagnosis, 
counseling, etc., either group or individual. Contributions are invited, 
especially summarized results of group testing, which will serve to facili- 
tate the accumulation of norms on a comparable basis and the exchange 
of data on similar research problems. 
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tried without running the risk of further complicating his ad- 
justment. All indications were that he had always been and 
was consistently right-handed. He was consistently right-eyed 
on eyedness tests. 

This report is confined to a discussion of method and results 
in the remedial work in spelling. 

The emphasis was put upon building up a basic spelling 
vocabulary of the most commonly used words. Words learned 
were systematically reviewed and where necessary re-learned 
until there was consistent accuracy. The Keller method of 
kinaesthetic training was used. 

The value of this method is incontrovertible. The most stub- 
born cases respond to this approach when all others have 
failed. Why it is effective is in part a matter of interpretation. 
Does the child substitute kinaesthetic imagery for visual im- 
agery? Does the simultaneous stimulation of visual, audi- 
tory, and kinaesthetic senses aid learning by providing multiple 
associations which facilitate impression and retention and in 
turn provide multiple clues to recognition and recall? Does 
the summation of stimuli facilitate visual perception in the 
case of one child, auditory perception in the case of another, 
and kinaesthetic perception in a third? Opinions differ. In 
the case of the boy reported there was objective evidence of his 
reliance on kinaesthetic cues. In some instances he hastily 
went through the motions of writing the word on the margin 
of the paper before writing it in its place on the page. 

All will agree that the child simultaneously experiences the 
word in a variety of ways. Also that the teacher ordinarily 
has no objective check on faulty ‘‘looking.’’ When she says: 
**But look at it!’’ and the child directs his eyes to the spot in- 
dicated, the teacher has no guage of the amount or kind of 
activity. Faulty tracing and pronouncing, on the other hand, 
are immediately apparent. Tracing and pronouncing insure 
activity in ‘‘looking’’ and provide an indication of the amount 
and kind of activity. They also provide appropriate associa- 
tions with what is seen. In addition they are directly con- 
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trollable. Furthermore their control automatically determines 
the direction and nature of inspection of the word and results 
in correct habits of inspection, which thus supplant and correct 
faulty eye-movements. Much, perhaps all, of the effectiveness 
of this approach is inherent in the above considerations. 

The method has been criticized because it is tedious and un- 
acceptable to the learner. Our practice in introducing this 
method to older children is to forestall this reaction by saying: 
‘*You may find this rather dull and tiresome, but you may 
take my word for it that it works and that’s the important 
thing.’” The immediate reaction is favorable. It requires 
varying degrees of tact and resourcefulness to keep it so. The 
boy in question accepted this without reservation and, since 
results were soon forthcoming, there was never any diminution 
in his effort and interest. 

At the beginning of remedial work he gained a grade posi- 
tion of 5.8 on the Morrison-McCall spelling scale. After work- 
ing eight and a half weeks (8} hours on spelling) his grade 
position on a comparable form of the test was 8.8. 

The first 284 words added to his spelling vocabulary were 
analyzed as to required re-learnings and kinds of errors. Sev- 
enty-one per cent were retained after the first learning, nine- 
teen per cent were re-learned once, eight per cent required a 
second re-learning, and one per cent were re-learned three 
times. 

It will be remembered that his mother stated his difficulty in 
spelling was his tendency to reverse letters. An analysis of 
types of errors for the 284 words showed this type of error to 
be of relatively minor significance both as to frequency and 
persistence. Errors could be classified roughly into four 
classes: (1) ineorrect auditory impressions, ¢.g., illistrate 
(illustrate), addation (addition), easer (easier), famious 
(famous); (2) confusion as to double or single letters, ¢.g., 
efect, dwel, accross, moove; (3) substitutions phonetically cor- 
rect, ¢.g., perpus (purpose), acer (acre), colidge (college), pre- 
pair (prepare); (4) reversals, e.g., peroid (period), anmial 
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(animal), captial (capital). The tabulation below shows the 
frequency of the different types in the first misspellings and 
subsequent re-learnings. 








TYPE I TYPE II TYPE II! 
NUMBER Faulty Single- Phonetic TYPE IV MISCEL- 
oF worDs Auditory Double Substi- Reversals LANEOUS 
Impression Letters tutions 
First Mis- 
Spelling 202 17% 18% 52% 7% 6% 
Re-] i 
I 54 31% 26% 31% 7% 4% 
II 23 9% 39% 49% 0 3% 
III 4 50% 25% 25% 0 0 





Since the fourth re-learning represents only one word, it is 
omitted. The results for the first misspellings and the re- 
learnings show that the most frequent confusions were of the 
first three kinds, and the most persistent were of the second 
and third kinds. The first two types are definitely related to 
his speech defect, faulty articulation, and stuttering. The 
emphasis on accurate enunciation of the word in learning it 
diminished the first type of error and at the same time assisted 
in the correction of the faulty articulation. More intensive 
effort was necessary to correct the second type, but the tendency 
to this type of confusion was simultaneously decreased by the 
accompanying speech work. The third type is the natural 
result of inadequate spelling experience. 








NEWS AND NOTES 


The Editors of this Journal have decided to set apart space in each 
succeeding issue if possible for contributions under the heading ‘‘ Brief 
Reports of Mental Testing.’’ These reports will consist of accounts of 
certain minor studies in this field. For some time the Journal has been 
in receipt of this kind of manuscript. Following correspondence with 
the contributors the minor studies will be condensed with, of course, the 
full understanding and cooperation of the contributors. At times the 
re-writing in the form of brief abstracts may be done by certain of our 
editors. At least outlines for re-writing will be furnished to the con- 
tributors. Those of our readers interested are referred to the footnote 
accompanying the contribution by Dr. Rose G. Anderson, Psychological 
Service Center, New York City, entitled ‘‘A Note on a Case of Spelling 
Diffieulty.’’ 


The University of Chicago Fifth Conference on Business Education 
will be held June 30 and July 1 at the School of Business. Leading 
educators and business men will take part in the program. The theme 
of the Conference will be ‘‘ Business as a Social Institution.’’ Opportu- 
nity for discussion will be provided at each of the four sessions. Exhibits 
of publications of interest will be held in rooms near the regular confer- 
ence rooms. Specific details of the program may be obtained from The 
School of Business. 


The Clinical Psychology Group of the National Conference of Social 
Work, organized in 1932, will hold its sixth annual session at Seattle, 
Washington, on June 28, 1938. Dr. Ruth M. Hubbard, Psychologist, 
Consultation Bureau of Detroit, will speak on ‘‘What Constitutes a 
Psychological Examination?’’ Inquiries concerning the sessions will 
receive prompt reply if addressed to Dr. Henry Feinberg, Chairman, The 
Clinical Psychology Group, National Conference of Social Work, 51 West 
Warren Avenue, Room 100, Detroit, Michigan. 


On Tuesday, May 3, the Fourth Spring Conference on Education and 
the Exceptional Child will be held under the auspices of the Child Re- 
search Clinic of the Woods Schools, at Langhorne, Pa. Outstanding 
educators, child psychologists and those concerned with the problems of 
the education of the exceptional child will appear on the programs. 
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The Office of Education, United States Department of the Interior, 
and American Junior Red Cross, announce one of the most extensive 
international broadcasts ever to be attempted. Addressed to school 
children throughout the world, the program will be carried by the NBC 
Red Network, General Electric Company short-wave stations, W2XAD 
and W2XAF, and by rebroadcast via many foreign radio stations, to be 
heard May 4, 6 to 6: 30 P. M. (EST), in cooperation with the National 
Education Association. The program entitled, ‘‘ Calling All Countries,’’ 
will feature six or eight ‘‘Juniors’’ delivering short tributes to the 
accomplishments of sixteen million American and foreign members 
throughout the world. Actors, orchestra and chorus of the Educational 
Radio Project, Office of Education, will dramatize the origin of the Junior 
Red Cross and sing its world song. Greeting from the Commissioner of 
Edueation, John W. Studebaker, one of the Junior Red Cross founders, 
will conclude the program. 


The Carnegie Foundation for the Advancement of Teaching has re- 
cently issued its thirty-second annual report of the president and of the 
treasurer for the year ending June 30, 1937. President Walter A. Jessup 
discusses the intensive competition now carried on between colleges for 
the recruiting of students. ‘‘No college can be free from the necessity 
of competing with other institutions. . . . In consequence it has adopted 
devices common to other competitive social and economic enterprises. It 
has changed the nature of its catalogue. It has employed publicity 
agents. It has pressed its alumni into service as recruiting officers. . . . 
Its ‘follow-up’ system is often very efficient indeed. And it has deemed 
itself forced to do these things by a feeling that it must struggle if it is 
to survive and go forward.’’ 

Dr. Williams 8S. Learned, staff member in charge of the Foundation’s 
ten-year study of the relation of secondary to higher education in Penn- 
sylvania, discusses the problem of maladjustment of college students. 
Only 50 per cent of the students who entered a Pennsylvania arts college 
in 1928 are known to have graduated; ‘‘the remainder withdrew before 
the course was finished for reasons that, with few exceptions, involved 
a miscalculation on the part of the individual or the institution or both. 
They were misplaced to the extent of severing their connection not only 
with the institution but, as far as we can learn, with the entire project 
of college education.’’ Dr. Learned has obtained and studied the opin- 
ions of 1,500 graduates of 49 colleges on the value of their college educa- 
tion. Those who reviewed their own experiences for the study believe 
in a college education and almost invariably testify that they benefited 
from it. 

Concerning professional accrediting and licensure, Dr. Alfred Z. Reed, 
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staff member, writes: ‘‘ Lawyers and physicians have begun to diverge 
from one another in their support of a policy of ‘standardizing’ educa- 
tional institutions. The American Bar Association and the Association 
of American Law Schools continue vigorously to apply standardizing 
methods.’’ But ‘‘both inside and outside the medical profession the 
view is now being expressed that, however valuable may have been the 
results accomplished by the standardization of medical schools in the 
past, there is grave danger that current activities of this sort may do 
more harm than good, by fettering the free development of medical 
science.’’ ‘*And recent discussions in university circles include denun- 
ciations of the basic idea. The time is ripe to analyze the fundamental 
concepts involved, however complicated they may be.’’ 

Dr. W. Carson Ryan, Jr., staff associate, examined the early days of 
graduate education at the Johns Hopkins University, Clark University 
and the University of Chicago, analyzing and making clear not only the 
internal relationships existing at the three universities in the closing years 
of the nineteenth century but also the external influences exerted upon 
instruction and research at other higher institutions. ‘‘With 18,000 
master’s or other first graduate degrees and over 2,800 doctor’s degrees 
granted by American colleges and universities in a single year, graduate 
education in the United States has departed considerably from the simple 
pattern of the third quarter of the nineteenth century. . . . At present 
the prime significance of the early days of these three American centers 
of advanced study is their contribution to American scholarship and 
scholarly method through quality, intellectual vitality, and singleness of 
purpose in their leadership.’’ . 

For 21 special research projects in education carriéd on at various 
universities in the United States and Canada during the year ended June 
30, 1937, the Carnegie Corporation of New York paid to the Division of 
Educational Enquiry of the Carnegie Foundation the sum of $106,700. 
Of these grants, seven went to tax-supported institutions, five to privately 
endowed institutions, nine to representative educational bodies for work 
carried on over the country. 

Copies of this annual report and other publications of the Foundation 
may be had without charge on application by mail or in person, to the 
office of the Foundation at 522 Fifth Avenue, New York City. 


Mr. Will H. Hays, recently elected president of the Motion Picture 
Producers and Distributors of America for the seventeenth time, declared 
in his annual report that ‘‘Industrial democracy can no longer be taken 
for granted anywhere in the world. It must be defended. . . . Self- 
regulation in the movie industry was a great laboratory experiment of 
self-government. The gains registered through self-regulation include: 
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1, The development of moral and artistic standards in motion picture 
production which has vastly improved the supply of popular entertain- 
ment and raised the artistic stature of the screen. 2. The maintenance 
of the highest possible advertising standards to make certain that pic- 
tures are properly exploited to the proper audiences on the basis of non- 
suggestive and honest advertising. 3. The creation of a widespread and 
consistent educational campaign to bring new audience elements to the 
theatre and secure support for the better pictures.’’ 

Propaganda, according to Mr. Hays, has no place on the entertainment 
screen. The function of the entertainment screen is to entertain, by what- 
ever wholesome theme or treatment writers, artists and dramatists can 
create. 

The motion picture industry is continuing its cooperation with edu- 
eators who are seeking to develop the usefulness of the motion picture in 
the processes of pedagogy. 

Discussing studio trends in the industry, Mr. Hays says: ‘‘ Present 
studio plans indicate that the American theatre public may look with 
confidence upon a continuing high quality of motion picture entertain- 
ment. The industry is built upon a triple foundation of artistic, social 
and economic requirements. ’’ 


The second annual Teachers Conference on Industrial Relations was 
held at the University of Michigan on May 6, 7 and 8, 1938. This Con- 
ference, made possible by a grant of funds by the Earhart Foundation, 
was held to provide information on topies currently important in the field 
of industrial relations and to provide opportunity for discussion of aims, 
scope and methods of academic instruction in this field. Many outstand- 
ing teachers of courses in personnel administration, industrial relations 
and labor problems from various universities took part in the three-day 
conference. Representatives were present from the University of Chi- 
cago, University of Wisconsin, University of Pennsylvania and the 
University of Michigan. 


A new correlation chart by Walter N. Durost and Helen M. Walker 
has recently been announced by the World Book Company. It is designed 
to facilitate the computation of Pearson product-moment coefficients of 
correlation and correlation ratios. It can be used either for hand or for 
machine computation. The operations are indicated both in standard 
statistical notation and in a simplified alphabetical notation, so that the 
chart may be used by individuals who have had no training in statistics. 
Not only are checks on the arithmetical processes involved occur at fre- 
quent intervals but each step in the computation is numbered from 1 to 
10 with arrows leading to the appropriate columns. 
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BOOK REVIEWS 


ALLPORT, G. W. Personality: a psychological interpretation. New 
York: Henry Holt & Co., 1937. Pp. XIV-588. 

This is one of those important books which are very hard to review 
because of the temptation to write about so many things. ‘‘My purpose 
is twofold,’’ writes Dr. Allport in his Preface, ‘‘(1) to gather into a 
single comprehensive survey the most important fruits of the psychologi- 
eal study of personality, and (2) to supply new coordinating concepts 
and theories where they will equip this new department of psychology for 
a more adequate handling of its endlessly rich subject-matter.’’ That 
psychology has been in serious need of a volume doing this, no one will 
deny. I think no competent psychologist will deny that Dr. Allport has 
come close to accomplishing these very difficult aims. Certainly his book 
will be a landmark in the history of personality study, and probably in 
the general history of psychology. 

Allport explicitly rejects the label of ‘‘ personalistic psychology’’ as an 
identification of his views. However, there is probably a closer psycho- 
logical kinship here than with any of the other recognized trends in 
theory. 

The significant contribution to theory of this volume lies first in the 
theory of traits, and second in the development of the concept of au- 
tonomy of motives. Since the two ideas are intimately related, I shall 
try briefly to summarize them together. The phrase ‘‘autonomy of mo- 
tives’’ refers to the fact that Allport regards ‘‘ adult motives as infinitely 
varied, and as self-sustaining, contemporary systems, growing out of 
antecedent systems, but functionally independent of them’’ (p. 194). 
Briefly put, this means that the motivational systems of the child (primi- 
tive, biological impulses) may be involved in setting up the needs of the 
adolescent or adult; but these later needs can by no means be adequately 
resolved into their earlier components. Thus, Allport uses the example 
of the musician who may first have been motivated by a desire to avoid 
criticism or obtain a reward; but after mastering his instrument, he loves 
it, and the music it produces, rather than the surrogates which once were 
involved in this acquisition. 

The concept of trait is employed as equivalent to a se deter- 
mining tendency which may control diverse forms of specific response. 
In this connection, Allport emphasizes the importance of functional 
equivalence of stimuli. It is not likely that the organism encounters 
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many situations which are identical in the sense which seems to be re- 
quired by the old theory of specificity of response. Instead, the organism 
treats as functionally equivalent many situations which, by atomistic 
analysis, are quite different. 

That some such interpretation of traits is necessary, anyone who has 
worked with personalities can testify. Whether it calls for the continu- 
ous emphasis upon the individual nature of each trait, is dubious. Re- 
ferring to the common practice of ‘‘measuring’’ traits by questionnaires, 
etc., Allport says: ‘‘ The psychologist . . . does not measure directly the 
full-bodied individual trait that alone exists as a neuropsychic disposition 
and as the one irreducible unit of personality. What he does is to mea- 
sure a common aspect of this trait, such a portion thereof as takes com- 
mon cultural forms of expression and signifies essentially the same manner 
of adjusting within the social group’’ (p. 298). This seems somewhat 
unjustified, in view of Allport’s own emphasis upon the functional equiva- 
lence of stimuli. That one man manifests aggressiveness by bossing his 
wife, while another reveals it through political activity, may still be sub- 
sumed under the concept of trait if we remember that the organism deals 
with varying situations in such a fashion that they become functional 
equivalents. 

The same criticism holds for the author’s constant emphasis upon the 
unique quality of each personality. Probably the specific kinds of needs 
which have been developed, and the specific habits which express funda- 
mental traits, will be different for differing adults. This superficial 
uniqueness need not confuse us as to the basic similarity of all personali- 
ties. One man likes caviar; another prefers limburger. Why emphasize 
the uniqueness rather than the similarity of the individuals concerned? 

Another point of criticism might be made with regard to the omission 
of any explicit discussion of cultural factors and their influence upon 
personality. Allport defends himself in his Preface by saying ‘‘the in- 
terest of psychology is not in the factors shaping personality, rather in 
personality itself as a developing structure. From this point of view cul- 
ture is relevant only when it has become interiorized within the person as 
a set of personal ideals, attitudes and traits.’’ The first sentence sug- 
gests an alarming leaning toward the old structuralist view that the con- 
tent of mind could be ignored. The second tends to counteract the effect 
of the first by emphasizing the fact that culture does become a part of 
personality. However, one searches the book in vain for explicit treat- 
ment of particular kinds of attitudes and values, for the relation of the 
individual to social progress, for the evidence of impact of culture change 
on personality organization. If I did not know Dr. Allport’s alert inter- 
est in social problems, I might suspect him of living in the ‘‘ivory tower’’ 
of academic monasticism. Certainly he could have gotten evidence, and 
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to spare, of the effects of culture disorganization upon stability of per- 
sonal values and attitudes. Allport’s phrasing of the question (Preface, 
p. ix) subtly implies that only neurosis and insanity are indicators of 
disorganized personalities. Surely many other indices, such as labor un- 
rest, political instability, persecution of minority groups, etc., show the 
trends of the times in personality disorientation. 

An interesting addition to the book is found in two chapters dealing 
with the ability to judge personality. Since the rating technique is still 
widely used, this section has implications for many researchers and should 
be studied carefully if they wish to know what the results of their observa- 
tions really indicate. 

Reacting to the book as a whole, I would say that it is well if some- 
what ponderously written. The methodical way in which the author goes 
about his task suggests at times (perhaps undeservedly) a steam-roller 
out crushing peanuts. The thoroughness of his scholarship would have 
stood up just as well without the impressive compilation of ‘‘ definitions’’ 
of personality and the history of obscure tendencies in physiognomy and 
phrenology. I have to admit that I skipped some sections of the histori- 
cal material on the grounds that they were ‘‘ irrelevant, inconsequent and 
immaterial.’’ On the other hand, I have read twice, and shall read 
again, many passages in which deep insight and understanding reveal new 
angles in this complex field of personality. 

This book is imperative for all teachers of courses in personality, men- 
tal hygiene and related fields, and for graduate students of any type of 
specialization. I doubt that any but the most advanced undergraduates 
ean deal effectively with it. It could be read with great profit by clinic 
workers and others whose practical work in personality problems needs 
orientation to psychological theory. 

Ross STAGNER, 
Uaiwersity of Akron. 


Bronson CrotHers, M.D. A Pediatrician in Search of Mental Hygiene. 
New York: The Commonwealth Fund, 1937. xix+271 p. $2.00. 

Probably one of the most serious problems that confronts modern men- 
tal hygiene activities is just who is properly prepared to undertake the 
strictly clinical work in this field. The physician, whether general prac- 
titioner or specialist, frequently capitalizes on the prestige of his profes- 
sion and lays claim to all problems that confront the individual whether 
they are organic or not. With perhaps more justification the psychiatrist 
would have all problems of behavior, especially in the realm of the emo- 
tions, considered his unique field. Social workers, more particularly those 
with psychiatrically colored training, often feel that social therapeutics 
is their task. Psychologists argue that because behavior is the subject 
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matter of the science of psychology they are best prepared to undertake 
clinical attention to problem behavior. Into any attempt to evaluate the 
relative merits of these different professional claims emotional bias and 
professional jealousies all too frequently enter. Nonetheless the problem 
of the training for clinical handling of behavior problems must some day 
be settled. 

Dr. Crothers, as a practicing pediatrician, undertakes to survey the 
field of mental hygiene, and to dispassionately evaluate the services of 
various professional groups engaged therein. In previous publications 
this author has suggested his point of view toward these problems, and 
in this book reiterates and clarifies many earlier statements. He up- 
holds, and rightly so, the responsibility of the pediatrician for physical 
ailments of children. He also quite rightly points out that in the minds 
of the lay public there is seldom a differentiation between organic illness 
and functional behavior maladjustment. Therefore, the pediatrician will 
inevitably be called upon to do something about the child’s behavior. 
Here he recognizes the limitations of the usual physician’s or pediatri- 
cian’s training and experience, and warns that ‘‘the doctor, by ruthless 
use of medical prestige, can block inquiry about mental and emotional 
problems,’’ but on the other hand ‘‘he is in a position of extraordinary 
natural strength if he chooses to include in his conception of pediatrics 
an intelligent interest in the confused but fascinating problems covered 
by the general term of mental hygiene.’’ 

With this basic thesis in mind Dr. Crothers presents an analysis of the 
reciprocal relations of mental hygiene and pediatrics in which he does 
not claim a superiority for pediatrics, but points out the mutual advan- 
tages of cooperation. The claims of various professions that they are 
interested in dealing with the ‘‘whole child’’ he looks upon with sus- 
picion, because he does not see any ‘‘real attempt at producing a scheme 
which gives anyone at all any claim to handling any considerable number 
of ‘whole children.’ ’’ In order to make the matter more concrete he 
discusses mental hygiene in general medical training, and in the children’s 
hospital; the values of the child guidance clinic; and describes the actual 
operation in the field at the Children’s Hospital in Boston. 

It is true that Dr. Crothers is writing a book primarily for pediatri- 
cians and next for the general medical practitioner. I am sure that an 
open-minded reading of this book by most of my medical friends would 
be very helpful to them. On the other hand this extensive essay has a 
good deal to teach the clinical psychologist who approaches it with an 
open mind. I highly recommend it to all psychologists working with 
children, and I should make it required reading for all students in the 
field of clinical psychology. 

C. M. Lourttr, 
Indiana University. 
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Warp, Lewis B. Reminiscence and Rote Learning. Psychological Mono- 
graph, 1937, Vol. 49, No. 4. 

It is pointed out that although reminiscence is a well established phe- 
nomenon, it has not been found in studies of rote learning of nonsense 
syllables. Most retention studies show a very rapid initial loss, and it 
has been assumed that this loss sets in immediately upon the completion 
of the learning period. The fact of this initial loss would suggest that 
the first few minutes or even seconds after learning might well be most 
important. It is this brief interval immediately following the cessation 
of the learning activity that the writer has undertaken to investigate. 

The experimental materials consisted of 12-unit lists of carefully 
selected nonsense syllables, presented to the subjects on a modified Chi- 
cago memory drum, driven by a synchronous phonograph motor, and so 
arranged as to give successive 2-second presentations of the syllables, 
with a pause of six seconds between lists. By means of an electrical 
chronograph and a Dunlap Voice Key, time intervals between the sub- 
jects’ verbal reactions and movements of the memory drum were recorded. 
Since the anticipation method (the subject anticipating the showing of 
the next item as early as possible in the learning process) was used, the 
significant time intervals were those between the verbal responses of the 
subjects and the appearance of the next item in the learning series. 
Thirty university students, naive and inexperienced as to this type of 
experiment, were used as subjects. Retention was tested after intervals 
of 4 minute, 2 minutes, 5 minutes, 10 minutes, and 20 minutes following 
the learning of the lists, after which the lists were re-learned. Such 
checks and controls as one would normally expect in an adequately planned 
and carefully executed experiment were employed but ¢annot be mentioned 
here. 

The author reports finding reminiscence immediately following learn- 
ing: ‘‘It was found that under these experimental conditions the curve 
of average retention for rote nonsense materials rises quickly within 2 
minutes after learning to a maximum of 10% or more above the level of 
immediate recall scores secured on control series.’’ Length of time of 
anticipation was found to be a good measure of retention. Of the sev- 
eral explanations of reminiscence which have been suggested in the past, 
the writer favors that of the dying out of inhibitory tendencies, giving 
the correct responses greater freedom to function. Eleven other conclu- 
sions in addition to the above three are listed. 

The writer discusses, and to some degree answers, the criticisms of 
Bartlett and English of the use of nonsense materials in.learning and 
memory experiments. 

Like any good experiment, this one is incomplete in that it raises more 
difficult problems than the ones it solves. Some of these problems are 
pointed out by the writer, who sees reminiscence in its proper perspective. 
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The experiment is concerned with fundamental principles, rather than 
with applications. It seems to this reviewer, however, that the implica- 
tions of experiments of this sort for applied psychology are somewhat 
analogous to the relation between foundation and superstructure; hence 
a review of this monograph in the JouRNAL OF APPLIED PsYCHOLOGY. 

Amos C. ANDERSON, 
Ohio University. 


Myers, C.8. In the Realm of Mind, Cambridge: at the University Press. 
New York: The Macmillan Company. Pp. 251. $2.50. 

While it is unlikely that this small volume satisfies any crying need in 
psychological literature, it undoubtedly has the virtue of covering a wide 
range of topics which have bearing on many present day psychological 
problems. 

The book consists of nine chapters based on lectures delivered in vari- 
ous places and to various groups during the years 1929 to 1935. Each 
lecture is concerned with a separate psychological problem and although 
the lectures are chiefly in the nature of applications of psychology they 
contain many items of theoretical value as well. 

The arrangement of the book has both advantageous and disadvantage- 
ous qualities. Since the material is heterogeneous in nature, it does not 
lend itself to patterning. In consequence of this there is no plan or 
connection between articles. The book thus has the discontinuity of any 
journal or magazine, but at the same time the virtue of variety and vital- 
ity. The author has, apparently, deemed it wise not to arrange the lec- 
tures in the order in which they were delivered. 

Because of the varied nature of the material each chapter must be dis- 
cussed as a separate unit. The first is concerned with the value of a 
psychological training to vocational guidance and includes tables of re- 
sults obtained from the testing program at the National Institute of 
Industrial Psychology. Psychology is helping in vocational guidance in 
four ways: ‘‘(1) in improved occupational analysis, (2) in the more 
reliable and more accurate measurement of mental abilities and qualities, 
(3) in insistence on a very broad attitude and a carefully balanced judg- 
ment in guidance, and (4) in the establishment of systematic methods 
of training advisers.’’ 

The second chapter is a discussion of accidents, with special emphasis 
on the fact that it is the task of the industrial psychologist to find the 
way to reduce this accident rate; in all situations, transportation, fac- 
tories and restaurants. The author recommends a selection of accident 
prone individuals with a view to giving them suitable training which has 
been found strikingly effective in reducing the accident rate. 

Musical appreciation and a discussion of attitudes and emotion is the 
topic of the next lecture. 
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‘*A Psychological Regard of Medical Education’’ embodies the author’s 
criticism of special training in separate fields, i.c., chemistry, biology, 
ete., without the chance of a cultural education as well. He argues for 
general medical education before specialization and points out the impor- 
tance of studying the organism as a whole, both from mental and physical 
points of view. The relationship between emotion and visceral activity, 
intelligence and endocrine deficiency, are certainly important both for 
psychology and for medicine. 

The remainder of the volume includes such various topics as the modern 
development of social psychology, psychological conceptions in other 
sciences, the absurdity of any mind-body problem, and the nature of mind. 
No one could say explicitly that any portion of the book is of greater 
importance than any other. What is valuable to a student of applied 
psychology is less interesting to the experimental psychologist. There is, 
however, material to the taste of everyone and the style and terminology 
throughout are well within the scope of the average undergraduate, who 
will undoubtedly find this entertaining and profitable collateral reading. 

K. W. OBERLIN, 
University of Delaware. 


Student Guidance Techniques: PATERSON, SCHNEIDLER AND WILLIAMSON, 
1938, New York, 1938, McGraw Hill Book Co., pp. 316 + XVIII. 

The subtitle of this book, ‘‘A handbook for counselors,’’ is a better 
characterization than the chosen title itself. The book is a valuable hand- 
book for all who offer advice to students. The authors leave little doubt 
that there is need for professional counseling, that such counsel must be 
based on facts, and that there are usable measuring devices to obtain some 
of these facts. 

The first two chapters present a brief overview of the diagnostic tech- 
niques. Interviewing techniques are outlined. Keeping cumulative per- 
sonnel records, recording of behavior items and ratings are briefly pre- 
sented. The place of measurement in a counseling program is discussed. 

The major portion of the book is devoted to the description of various 
tests. The authors do not propose to present a complete catalog of avail- 
able tests, but a rather select list, selected on a basis of validity and 
utility. For each test they give the following information: a brief 
description of the test, kinds of students or persons for whom it was 
designed, brief norms, reliability and how obtained, a discussion of the 
validity, the publisher of the test, cost of tests, and references in which 
more detailed information may be found. Such selection and: description 
of tests itself makes the book well worth its price. 

The last four chapters take up a discussion of diagnosis and handling 
of educational problems, vocational problems, personnel problems, and 
guidance as a professional service. 
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Persons considering entering school personnel work may well look to 
the qualifications as specified in this book. The authors admit their 
standards are much higher than those that have prevailed, but in looking 
to the needs they are not content. It is a skilled profession and only as 
such should it be developed. The responsibility of the position should 
presuppose ability and training—at least a master’s degree in Psycho- 
metrics or its equivalent, experience, intellect, definite interests, and per- 
sonality qualifications, not forgetting he is not a specialist in every field 
and should be alert to referral cases. 

Along with this excellent handbook, one may well read Bingham’s 
‘*Appitudes and Aptitude Testing.’’ Both are books to be used by 
the counselor whether he be dealing with high school pupils, college stu- 
dents, or with out-of-school youth. 

Haroip A. EpGErTOon, 
Ohio State University. 
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The Student and His Knowledge. Wiut1aM 8. LEARNED AND Ben D. 
Woop. Carnegie Foundation for the Advancement of Teaching, Bul- 
letin No. 29. New York, 1938. 406 pp. 

Studies in Group Behavior. Grace LoNGWELL Corts. Harper Brothers, 
New York, 1937. $2.75. 258 pp. 
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Social Adjustments. Nog. Keys. University of California Press, 
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